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LOCALIZED NONLINEAR FUNCTIONAL EQUATIONS AND 
TWO SAMPLING PROBLEMS IN SIGNAL PROCESSING 

QIYU SUN 



Abstract. Let 1 < p < cxo. In this paper, we consider solving a nonlinear 
functional equation 

fix) = y, 

where x,y belong to i^ and / has continuous bounded gradient in an inverse- 
0^ , closed subalgebra of B{i^), the Banach algebra of all bounded linear operators on 

the Hilbert space l"^. We introduce strict monotonicity property for functions / 
.^ , on Banach spaces £p so that the above nonlinear functional equation is solvable 

fT , ' and the solution x depends continuously on the given data y in £p. We show 

that the Van-Cittert iteration converges in £p with exponential rate and hence it 
could be used to locate the true solution of the above nonlinear functional equa- 
2 . tion. We apply the above theory to handle two problems in signal processing: 

nonlinear sampling termed with instantaneous companding and subsequently av- 
erage sampling; and local identification of innovation positions and qualification 
of amplitudes of signals with finite rate of innovation. 

^ ■ 1. Introduction 

Tj- ! Let i^ := i^{Af), 1 < p < oo, he the space of all real- valued p-summable column 

^ I vectors x := {x{n))nej\f on a countable index set Af with its norm denoted by || ■ ||p : = 

II • ||£p(Ar)- In the first part of this paper, we consider solvabihty and stabihty of a 

nonlinear functional equation 

><: (1-1) fi^) = y 

j^ [ in Banach spaces ^^, 1 < p < c>o. We assume that both the original signal (image) x 

to be recovered and the distorted signal (image) y to be observed belong to i^, 1 < 
p < cxo. We also assume that the function / in the nonlinear functional equation 
(II .ip has continuous bounded gradient V/ in an inverse-closed Banach algebra of 
infinite matrices with certain off-diagonal decay (hence being localized and near 
sparse). Here the gradient V/ of a function / on i'^ is defined by 

V7ff \ V /(^ + ^C) - f{x) 

y jixjc := lim tor x,c & F. 

t-5>0 t 
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2 QIYU SUN 

Such a hypothesis is satisfied for functions / modehng a distortion procedure that 
has strong neighborhood dependency; i.e., the change in amphtude of the distorted 
signal (image) /(x) at each position depends essentially on the change in amplitudes 
of the original signal (image) x at neighboring positions. 

For the nonlinear functional equation (II. ip in the Hilbert space i"^, a well-known 
result is that it is solvable and stable provided that the function / is strictly mono- 
tonic on £^ and has continuous bounded gradient in B{i'^), see for instance [IHl |69] 
or Lemma [231 Here B{i^), 1 < p < oo, is the Banach algebra of all bounded linear 
operators on i^, and a function / on i'^ is said to be strictly monotonic [69j if there 
exists a positive constant rriQ such that 

(1.2) (x — x')'^(/(x) — /(x')) > mo(x — x')"^(x — x') for all x, x' G £^. 

The strict monotonicity constant of a function / on £^ is the largest constant mo 
such that (II. 2p holds. If a function / on £^ has continuous gradient V/ in -B(£^), an 
equivalent formulation of its strict monotonicity is that 

(1.3) c^V/(x) c > moc^c for all c e f and x e f. 

In this paper, we consider the nonlinear functional equation (II. ip in Banach spaces 
£^,p 7^ 2, see Remark 15.41 and Section [8] for some of our motivations related to signal 
fidelity measures and local identification of innovations. We introduce the following 
"strict monotonicity" property for functions on i^,l < p < cxd, 

(1.4) c^Vf{x)c > itlqC^c for all ce f and x G &', 

where m^ > 0. We call (ll.4p the strict monotonicity property because of its similarity 
to the equivalent formulation (II. 3p of the strict monotonicity for a function on i"^. 
We remark that the strict monotonicity property (11.40 for functions on Banach 
spaces could be verified more easily than the strong accretivity defined by Browder 
[^ and Kato [53] via normalized duality mapping, especially for functions arisen in 
nonlinear sampling and reconstruction. We show in Theorems 14.11 and 15.11 that the 
nonlinear functional equation (ll.lj) is solvable and stable in £^,1 < p < oo, if / has 
continuous bounded gradient in some Banach subalgebra of B{i'^) and satisfies the 
strict monotonicity property (II. 4p . The proofs of Theorems 14 . 1 1 and 15 . 1 1 rely heavily 
on a nonlinear version of Wiener's lemma (Theorem 12. ip and a unique Lipschitz 
extension theorem (Theorem 13. ip for strictly monotonic functions. 

In the second part of this paper, we consider finding the true solution of the 
nonlinear functional equation (II. ip with 1 < p < oo. For a strictly monotonic 
function f on i"^, consider the Van-Cittert iteration: 

(1.5) Xn+i = Xn-a{f{xn) -y), n>0, 

where xq G i'^ is the initial guess and a > is the relaxation factor. By the strict 
monotonicity property (II. 3p . we obtain that 

Ikn+i -x„||2 < (l -2amo + a^(sup ||V/(x)||b(£2))) ||x„ -x„_i||2 for all n>l. 
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Thus we conclude that if < a < 2mo/(sup2,g£2 ||V/(x)||b(£2)) then for any initial 
guess Xq, the sequence x„,n > 0, in the Van-Cittert iteration (ll.Sp converges expo- 
nentially to the true solution f~~^{y) of the nonhnear functional equation (11. II) . i.e., 
there exist constants C G (0, oo) and r G (0, 1) such that 

\\xn - f~\y)\\2 < Cr'' for all n>l. 



In Theorem 16.11 we borrow a technique in [581 EO] used for establishing Wiener's 
lemma for infinite matrices, and we show that the sequence x„,?t, > 0, in the Van- 
Cittert iteration method converges to the true solution f~^{y) in i^,l < p < oo, ex- 
ponentially, provided that < a < mo/(sup^.g£oo \\^ f{x)\\B{e'^)+snp^^ioo ||V/(x)||L^2)) 
and the function / has continuous bounded gradient in some inverse-closed Ba- 
nach algebra B satisfying the differential norm property fl2.2p . Therefore the Van- 
Cittert iteration method could be applied to locate the true solution of the (infinite- 
dimensional) nonlinear functional equation (II. ip with p ^ 2. We are working on 
other methods that could solve the nonlinear functional equation (II. ip with p ^ 2 
in a more stable and efficient way. 

In the third part of this paper, we consider applying the above theory about 
solving the nonlinear functional equation (11.10 to two sampling problems in signal 
processing. We first apply it to a nonlinear sampling problem related to instanta- 
neous companding 

(1.6) F: hit) ^ F (hit)), 

see Figure [H The technique to transmit (process) the companded signal F{h{t)) 
instead of the original signal h{t) is useful in a transmission system that does not 
respond well to very high or very low signal levels, since that instantaneous com- 
panding technique may amplify the weaker parts of a signal and de-emphasize its 
stronger parts. There are some theoretical obstacles in the path of instantaneous 
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Figure 1. The left hand side is the original image, while the right hand 
side is the distorted image via F(t) = 255sin(7rt/510). 
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companding. For instance, the instantaneous companding fll.6p does not preserve 
the bandhmitedness. A good news by Beurhng |1D] is that no information of a sig- 
nal h{t) bandhmited to [—7fQ,TTQ],Q > 0, is lost by transmitting the companded 
signal F{h{t)) over bandlimiting channel [— Trfi, 7rf2], provided that the compand- 
ing function F is monotonic increasing. Precisely, the procedure of instantaneous 
companding and subsequently bandlimiting, 

_ , instantaneous companding ,-, / , \ bandlimiting „ , _ , , ^ , _ 

B^n3h ^ ^ "^ F{h) -^ Pnn{F{h)) e B^n, 



is one-to-one on B^^q [lOl [53]. Here B^^q is the Paley- Wiener space containing all 
square-integrable functions bandlimited to [—irQ, nfl], P^^ is the projection operator 
from L^ to the Paley- Wiener space B^^q, and L^ := L^{M.'^), 1 < p < oo, is the space 
of all p-integrable functions on M'^ with its norm denoted by || • ||p := || • ||LP(iRd), while 
the inner product on L^ is denoted by (■,■)• 

In this paper, we consider a nonlinear sampling procedure of instantaneous com- 
panding and subsequently average sampling [17]: 

, , „ , instantaneous companding „ / , n average sampling , , , , , 

(1.7) Sf,^ ■■ h — > F{h) — > (F(/i),^), 

where \E' = {ip^)^^r is the average sampler, F C M*^ is the index set representing the 
location of the nonideal acquisition devices, and the sampling functional ip.y at the 
sampling position 7 G F reflects the characteristics of the acquisition device at that 
location. Such a nonlinear sampling procedure appears in a variety of setups and 
applications, such as charge-coupled device image sensors [211 El], power electronics 
\5T\ , radiometric photography, magnetic resonance imaging [TSl ESI El] , and band- 
limited signal transmission [IHIES]. It would be an ill-posed problem to reconstruct 
a signal h from its nonlinear sampling data SF,^{h) if no a priori information on the 
original signal h is given. In this paper, we assume that signals to be recovered are 
superposition of impulse response of varying positions and amplitudes. 



(1.8) h{t) = Y,<\)Mt), 

AeA 

where A is the index set with each A G A representing an innovation position of the 
signal, $ := {(f)x)x£A is the generator with each entry (f)x being the impulse response 
of the signal generating device at the location A, and c := (c(A))a6A is the amplitude 
vector with each entry c(A) being the amplitude of the signal at the innovation 
position A, which is assumed to be p-summable for some 1 < p < 00 in this paper. 
In other words, signals to be recovered reside in the space 

(1.9) Vp{^) := {c^<l>| c G F(A)}, 1 < p < 00 



([61]). We remark that signals, such as bandlimited signals in a Paley- Wiener space, 
time signals in a finitely-generated shift-invariant space, time-frequency signals in 
Gabor analysis, and signals in a reproducing kernel subspace of L^, have the para- 
metric representation (ll.Sp [IHl [SH [Blj • 
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Associated with the nonhnear samphng procedure fll.7p for signals in the space 
Vp{^) is the function 
(1.10) 

„ /in/ « \ T 3: instantaneous companding and average sampling ,_/7-'_, _, /,n/-n\ 

/f,$,m> : fP(A) 9 c — >c^^ ^ ^ B p "^ {F{c^^),-^) eF{T). 

For the function /f,*,-!- just defined, its gradient function 

V/f,$,vi,(x) : F{A) H— > FiT), X e F{A) 

is a family of infinite matrices (aA,7(a;))AeA,7er with uniform off-diagonal decay, pro- 
vided that the companding function F has continuous bounded gradient and that 
both the generator $ and the average sampler \l/ are well-localized, such as when 
they have polynomial decay of order /3 > d, see Lemma 17. 6[ Here we say that 
$ = (0a)aga has polynomial decay of order (3 if 

(1-11) ll-^lloo,/? := sup ||0a(-)(1 + I ■ -AD^Iloo < 00. 

AeA 

So we may apply the established solvability and stability of the nonlinear functional 
equation (11. ip to study the stability of the nonlinear samphng procedure (II. 7p . and 
the Van-Cittert iteration method to reconstruct signals h e Vp{^) from its nonlinear 
sampling data (F(/i),\l/), see Theorems 17.11 and 17.71 for the theoretical results and 
Section 17.31 for the numerical simulations. The readers may refer to p!7l [19] for the 
study of the nonlinear sampling procedure (I1.7P from an engineering viewpoint. 

A signal is said to have finite rate of innovation if it has finitely many degrees 
of freedom per unit of time [66]. In the second application of our theory about 
solving the nonlinear functional equation (II. ip . we consider precise identification of 
innovation positions and accurate qualification of amplitudes of signals with finite 
rate of innovation. These are important to reach meaningful conclusions in many 
applications, such as global positioning system, ultra wide-band communication, 
and mass spectrometry. The readers may refer to [TJ HSl ESI SSI SSI SSI ESI ES] and 
references therein for various techniques, such as the annihilating filter technique 
and the polynomial reproducing technique, that have been developed by Vetterli 
and his school to attack that challenging problem. 

Signals living in the space Vp{^) have finite rate of innovation provided that the 
generator $ = {(px)\^A is well-localized (for instance, $ has polynomial decay of 
order P > d) and the index set A is a relatively-separated subset of W^ [61] . Here a 
subset A of M'^ is said to be relatively-separated if 

(1.12) sup ^Xa+[o,i)^(^) < OO' 

where xe is a characteristic function on a measurable set E. In applications such as 
global positioning system, cellular radio, ultra wide-band communication, and mass 
spectrometry [TTl [T2l [T5| [39] , signals have the parametric representation (11.80 but 
both the innovation position set A and the amplitude vector c := (c(A))AeA need 
to be determined. The dependence of the impulse response 0a at the innovation 
position A could be given or determined. For instance, the impulse response 0a is 
assumed to be approximately the shift of a given impulse ip (i.e., 0a ~ (p{- — A)) 
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in [m dSl [39], and the dilated shift of a given shape ^ with unknown width w\ 
(i.e., ^\ ~ (^((- — X)lw\) ) in [15]. In this paper, we assume that the dependence 
of the impulse response 0a on the innovation position A is the shift of a given 
impulse response y?, i.e., 0a = '^i: ~ ^)- So signals have the following parametric 
representation 

(1.13) Mt) = 5^c(AM--A). 

AeA 

We could also say that signals live in an almost- shift-invariant space generated by 
(/?, as in the Fourier domain 

(1.14) m = ciom 

is the product of an almost periodic function C(^) := XIasa c(A)e~*'^^ and the Fourier 
transform of the impulse response if. Here the Fourier transform f of an integrable 
function / on M*^ is defined by /(^) = J^^ e~^^^f{x)dx. 

In Section [HI we consider recovering a signal h in the parametric representation 
(I1.13P accurately from its nonlinear sampling data {F{h), \I'), with a priori approx- 
imate information on innovation positions and amplitudes. For that purpose, we 
require that the linearization of the nonlinear sampling process 

, , , _ , /Ax parametric representation I I1.13D , companding and sampling , , , , , 

(1.15) (^^j -^ h ^ (^(/i),^) 

is stable at the given approximate innovation position vector Aq and amplitude 
vector Co = (co(A))AeAoJ i-^-, there exist positive constants A and B such that 

(1.16) A\\e\\2 < ||5A„,coe||2 < B\\e\\2 for all e G {f{Ao)Y^\ 
where 

m7^ c ._( -Co{X){F'{ho)V^i--\),i;,) 

^^ ^ '°'"-"V (F'(M^(--A),V^,) ,^,,,,,,„ 

and ho = XIasa '^o(-^)v^(" ~ X)- Associated with the linearization of the nonlinear 
samphng process (ll.lSp at (Aq, cq) is the function 

(1-18) /ao,co,* : (3 ^ {Sl,e,S^,,J-'Sl^jF{h)-F{ho),^), 

where a = (a(A))AeAo, c = (c(A))AeAo and h = EAeAo(co(A) + c{X))(p{- - A - a(A)). 
We observe that the gradient of the function /aq.co,* is a family of infinite matrices 
with certain off-diagonal decay, and that /ao,co,* has strict monotonicity property 
in a small neighborhood of the origin; i.e., 

inf e^V/Ao.co.M-f Je > 

iieii(,2(Ag))d+i-i \<-y 

for all a G (£°°(Ao))'^ and c G £°°(Ao) with ||c||oo + lk||oo < 5o, where 6o > 
is a sufficiently small number. Thus we may apply our theory about solving the 
nonlinear functional equation (II. ip with p = oo indirectly to local identification of 
innovation positions and qualification of amplitudes, see Theorem 18.11 
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Finally we consider the following natural questions: 1) how to find approximate 
innovation positions and amplitudes from the given sampling data and 2) how to 
verify the stability condition fll.l6p for the linearization matrix. From the stability 
condition f ll.l6p it follows that approximate innovation positions should be sep- 
arated from each other and that approximate amplitudes at innovation positions 
should be above certain level. So we may model those signals as superposition of 
impulse response of active and nonactive generating devices located at an unknown 
neighborhood of a uniform grid; i.e., after appropriate scaling, we may assume that 
signals live in a perturbed shift-invariant space 

(1.19) V^,^{^;a):={j2c{kM--k-aik)) \ {c{k)),^^. E i^iZ')] 



with unknown perturbation a := {o'{k))i^^^d, where 

(1.20) £^(Z'^) = {c := (c(A;))fcez^| ||c||,^ := sup |c(A;)| + |c(A;)|-^ < cx)|. 

We may assume that signals live in the infinite unions of almost-shift-invariant spaces 
Uo-\4o,0((/3; a), see [H] for sampling in finite unions of subspaces. A negative result for 
sampling in the perturbed shift-invariant space with unknown perturbations is that 
not all signals in such a space can be recovered from their samples provided that (p 
satisfies the popular and traditional Strang-Fix condition. The reason is that in this 
case, one cannot determine the perturbation ctq of signals J2keZ'' V^(' ~ ^ ~ c"o); ^"o ^ 
M*^, as they have same constant amplitudes and are identical. In Theorem 18. 3[ 
we provide a positive result for sampling in a perturbed shift-invariant space with 
unknown perturbations. We show that any signal /i in a perturbed shift-invariant 
space Voo,(Z){<f', cr) with small perturbation error ||cr||oo can be recovered from its 
sampling data {{h,iprn{- — k))\l < m < M,k E Z'^} provided that 

(1.21) rank A^'i;)^^) ■•• ^^^M^A=d + l for alU G [-vr, vr^ 

see Remark 18.41 for the connection of the above assumption with sampling in shift- 
invariant spaces. Here the bracket product [/, g] of two square-integrable functions 
/ and g is given by [/, g] (0 = E^ez^ /(^ + 2l7i)g{^ + 2l7i). 

The paper is organized as follows. The first part of this paper contains four sec- 
tions concerning solvability and stability of the nonlinear functional equation (II. ip . 
The starting point of solvability is Wiener's lemma for strictly monotone functions 
in Section [21 A sufficient condition for the solvability of the nonlinear functional 
equation (II. ip in i^ is introduced in Section HI while the unique Lipschitz extension 
theorem in Section [3] and Wiener's lemma in Section [2] are crucial in the proof. The 
stability of the nonlinear functional equation (II. ip in i^ is studied in Section [51 The 
central pieces of the second part of this paper are the global exponential conver- 
gence of the Van-Cittert iteration in i^ and the local R-quadratic convergence of the 
quasi- Newton iteration in £^,1 < p < oo, see Section [6] for details. Our proof of the 
global exponential convergence depends heavily on the paracompactness idea used 
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in [58| [60] to establish Wiener's lemma for infinite matrices. In the third part of this 
paper, we apply solvability and stability of the nonlinear functional equation f ll.ip 
in the first part and numerical implementation in the second part to two sampling 
problems in signal processing: 1) stable recovery of signals h living in the space 
Vp{(^) from their nonlinear sampling data {F{h), \E') in Sections [71 and 2) local iden- 
tification of innovation positions and qualification of amplitudes of signals h having 
the parametric representation ( I1.13P from their nonlinear sampling data {F{h),'$) 
in Section [HI 

In this paper, the capital letter C denotes an absolute constant, which may be 
different at different occurrences. 

2. Nonlinear Wiener's lemma 

A Banach subalgebra A oi B is said to be inverse- closed if an element in A, that 
is invertible in B, is also invertible in A. Inverse-closedness occurs in many fields 
of mathematics under various names, such as spectral invariance, Wiener pair, and 
local subalgebra. Inverse-closedness (= Wiener's lemma) has been established for 
infinite matrices satisfying various off-diagonal decay conditions (or equivalently for 
localized linear functions on iP) , see for instance [Sl[Sll2ni[2Sl[2Sl[321[S51[5ZllMll5nilS3] 
and the survey papers ^T\ ^7\ . Wiener's lemma for infinite matrices plays crucial 
roles for well- localization of dual wavelet frames and Gabor frames [U ^U\ [321 EB], 
algebra of pseudo-differential operators [221 ISll [57] , fast numerical implementation 
[101 [IS [28], stable signal recovery [H [3 [281 [301 [591 [61] , and optimization [13 [H]. 

A quantitative version of inverse-closedness is to admit norm control, which is 
fundamental in our study of the nonlinear functional equation fll.ip and its applica- 
tions to sampling in signal processing. Here an inverse-closed Banach subalgebra A 
of B is said to admit norm control in B if there exists a continuous function h from 
[0, oo) X [0, oo) to [0, oo) such that 

\\A-'\U<hi\\A\U\\A-%) 

for all A e v4 with A~^ e B. Unlike the inverse-closedness, there are not many papers 
devoted to the above quantitative version of inverse-closedness [221 [211 \SS\ [M] • The 
algebra W of commutative infinite matrices of the form A := (a(i — j))ij£i with 
norm ||v4||yv; = XIjgz 1*^0)1 ^^ inverse-closed in B{(?) by the classical Wiener's lemma 
[68] but it does not admit norm control [50]. The C*-subalgebras A oi B with a 
common unit and a differential norm, i.e., 

(2.1) \\AB\\a<C{\\A\\a\\B\\b+\\A\\b\\B\\a) ioi a\\ A,B e A C B, 

was shown in [23] to admit norm control. The smoothness described in the above 
differential subalgebra ^ of ;B has been widely used in operator theory and non- 
commutative geometry [HI [3S1 [S2] and also appears in approximation theory [2]. 
For the quantitative version of inverse-closedness, we will show in Proposition 12.41 
that a Banach subalgebra A of i3(£^) admits norm control in B{i'^) if it contains the 
identity matrix J, it is closed under the transpose operation, and it satisfies 
(2.2) 
\\AB\U < Co{\\A\U\\BfjBg-^,^ + \\B\U\\A\fJAg-^,^) for all ^^ e ^ C 
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where Cq G (0, oo) and 6 G [0, 1). The above inequahty (12. 2p . a weak form of the 
differential norm property f l2.ip . is satisfied by many famihes of Banach subalgebras 
of B{i^) [261 ESI EU [601 ES] , and it will also be used later to guarantee the exponential 
convergence of the Van-Cittert iteration method, see Theorem 16.11 

The main topic of this section is to introduce Wiener's lemma for strictly mono- 
tonic functions, see Theorem 12.11 It states that a strictly monotonic function on 
£^ with continuous bounded gradient in some inverse-closed subalgebra of i3(£^) has 
its inverse with continuous bounded gradient in the same Banach subalgebra. The 
above nonlinear Wiener's lemma will be used later to establish the unique extension 
theorem (Theorem 13.11) and the invertibility theorem (Theorem 14. ip for functions 
with continuous bounded gradient in a Banach subalgebra of i5(£^). 

Theorem 2.1. Let A be a Banach subalgebra of B{^'^) that admits norm control in 
^^\ If f is a strictly monotonic function on £^ such that its gradient V/ is bounded 



and continuous in A (i.e., sup2,g£2 ||V/(a;)m < oo and lima./_>.a, in ^2 ||V/(x') — 
V/(x)m = for all x G l'^), then f is invertible and its inverse f~^ has continuous 
bounded gradient V(/~^) in A. 

For a relatively-separated subset A in (11.120 and a nonnegative number P > 0, 
define the Jaffard class J7/3(A) of infinite matrices A = (a(A, A'))A,A'eA by 

(2.3) Jf,{A):=\A ||Ab^(A):= sup (1 + |A - A'|)^|a(A, A')! < ooj 

[32l [58] . The Jaffard class can be interpreted as the set of infinite matrices having 
polynomial off-diagonal decay of degree (3. It has been established in [5H1 [SO] that 
the Jaffard class J7'^(A) in (12. 3p with f3 > d is closed under the transpose operation, 
it contains the identity matrix J, and it satisfies the differential norm property 
(12.20 . Hence the Jaffard class J7/3(A) with (3 > d admits norm control in i3(£^) by 
Proposition 12. 41 at the end of this section. Then applying Theorem 12. II to the Banach 
algebra J7/3(A) leads to the following conclusion. 

Corollary 2.2. Let (i > d and A be a relatively- separated subset of M.'^. If f is 
a strictly monotonic function on £^(A) such that its gradient V/ is bounded and 
continuous in Jj^{K), then f is invertible and its inverse f~^ has continuous bounded 
gradient in Jp{K). 

To prove Theorem 12. 11 we recall a textbook version, i.e., A = B^i"^), about invert- 
ibility of a strictly monotonic function on i"^, see for instance [69] . 

Lemma 2.3. Let f be a strictly monotonic function on i"^ such that its gradient V/ 
is bounded and continuous in B{(?'). Then f is invertible and its inverse f~^ has 
continuous bounded gradient in B{(?'). 

Proof of Theorem \2.1\ Since ^ is a Banach subalgebra of B{(?), the gradient V/ is 
also bounded and continuous in Bi^f') by the assumptions on /. Then / is invertible 
and the gradient of its inverse f~^ is bounded and continuous in B{(?) by Lemma 
Therefore the gradient V(/~^) is bounded in ^ as ^ admits norm control in 
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i3(£2) and 



-^'x) 



(2.4) V/(r^(x))V/ 

by f{f~^{x)) = X for all x G i"^. Combining (12 .4^ with the boundedness of V/ in A 
and the continuity of f~^ on i"^, we obtain that for any yo G i'^ 

||vr^(i/)-vr^(i/o)lL = ll(v/(r^(i/)))''-(v/(r^(yo)))"lL 

< (sup||(V/(^))-^||j'||V/(r^(t/))-V/(/-^(yo))|L 

— )■ as y — > I/O in ^^• 
This proves the continuity of V(/~^) in A. D 

Denote by A^ the transpose of an infinite matrix A. We conclude this section by 
showing that a Banach subalgebra A of B{i'^) satisfying fl2.5p . a weak version of the 
differential norm property (12.21) . admits norm control in 



Proposition 2.4. Let A be a Banach subalgebra of B{(?) such that it contains the 
identity matrix I and it is closed under the transpose operation. If there exist positive 
constants D G (0, cxd) and 9 G [0, 1) such that 

(2.5) \\A^\\a < D\\A\\]+%\A\\l-f^l^^ for all AG A 

then A is an inverse- closed Banach subalgebra of B{(!,'^). Moreover, for any A E A 

with A-^ G B{e), 

(2.6) 

oo 

\\A-^\\ . < WA^W A\A\\-^ Vr"(Dnini . + M^ll A\A\\ A\A-M\-^ ^^-l\'-V^'°''^'*'^ 



n=0 



ifde (0,1), and 
(2.7) 



oo 



14^^11 . < M^ll JI4II-2 \^ r'^(D(\\T\\ A ^ M^ll aWAW JI/l^Mr^ V^^V 



n=0 



zfe = 0, where r = 1 - (p-i||e(f2)||A||e(£2))-2 g [0, 1). 

Proof. We provide only a brief sketch of the proof as we can mimic the argument in 
[58j where A is the Jaffard class. Let A G A with A^^ G B{i'^). Then the product 
A'^A between A and its transpose A^ is a positive operator on i"^ by the invertibility 
assumption on A, 



(2.8) (l-r)/<^n^ </ 



A^A 

\A\ 



lB(£2) 

for some positive constant r = 1 — (||A^^||g(£2)||y4||g(£2))^^ G [0,1). Set B = I 
A'^A/WAWl^.^y Then 

(2.9) \\B\U < \\I\\a + P^|UP|Up||g2,2) < oo 
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as ^ is a Banach algebra closed under the transpose operation. Using f l2.5p and 
rS]) . and recalling that .4 is a Banach algebra, we obtain that for all n > 0, 



U 



(2.12) < {D\\BUr-'y-^^"''''^''r^ 



(2.10) ||5'"+1^ < ||5|U||E2"|U 

and 

in ^ T\ ||r52n|| ^ T\\\ TDn 111— S jj Rn jj 1+9 ^ r~< ^n(l—9) \\ Tyn\\l+9 

(2.11J ii-D m<ij||_» iIb(^2)||-d iu ^^0^ ii-D ii_4 , 

where D and 6 are given in (12. 5p . Applying (I2.10p and (12. lip iteratively, we get 

||5"|U < D||5||>^S'=i ^'2'||ES-i ^'2-^11^+^ <■■■ 

< ( 

if ^e (0,1), and 

(2.13) ||5"|U < (D||5|Ur-^)i+'°S2vn 

if 6^ = 0, where n = J2i=o ^j2* with e^ G {0, 1} and e/c = 1. Then A^^ G ^ as 

oo 

(2.14) A-' = {A^Ay'A' = P||-(2,,)5^i?M^. 

n=0 

The estimates ^M) and ([ZZD hold by ^Ml, fl232D . fl27[3|l and fl27[ip . D 

3. Unique extension 

In this section, we apply the nonlinear Wiener's lemma (Theorem 12. ip established 
in the previous section, and show that a strictly monotonic function / on £^ with 
continuous bounded gradient in some Banach algebra can be uniquely extended to 
a continuously invertible function on £^, 1 < p < oo. 

Theorem 3.1. LetM he a countable index set, A be a Banach subalgebra ofB{i'^{Af)) 
that admits norm control in B{l'^{M)), and let f be a strictly monotonic function 
on (?{N') with the property that /(O) = and the gradient V/ is bounded and 
continuous in A. Then 

(i) the function f can be uniquely extended to a continuous function F on 

i^{M), I < p < oo, if A is a Banach subalgebra of B{P'{N)); and 
(ii) the function f can be uniquely extended to a continuous function F on i°°{Af) 
with respect to the weak-star topology, provided that A is a Banach subalgebra 
of B{i°°{Af)) and that there is a family of nested finite subsets Mm,fn > 1, 
ofJ\f such that U'^^^J^fm = M , Mm C Mm+i for allm > 1, and the projection 
operators Pm,m > 1, defined by 

PmX = ix{n)xAf^in))nejv for x = {x{n))nejV e i'^iM), 

satisfy 

(3.1) lim sup ||PmA(/-P„+i)||B(^oo(_v)) = 0. 
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Moreover, the above unique extension F has continuous inverse F^^ on i^{Af), 1 < 
p < oo, and satisfies the following uniform Lipschitz conditions: 

(3.2) ||F(x)-F(x')||p< ( sup ||V/(2;)|U)( sup \\A\\isii.(^My))\\x - x'\\p 

z&e.\M) \\a\\a<i 

and 

(3.3) \\F-\x)-F-\x')\l<{ sup \\Vf-\z)U){ sup P||B(^p(^r))) ||x - x'||p 

z(il'^(J\f) \\A\\a<1 

for all X, x' e i^{Af), 1 <p < oo. 

The technical assumption 03. ip for a Banach algebra A of B{i°°{f/)) can be 
thought as a weak version of band-limited approximability, as it holds if 

lim sup \\A - Arr,\\B{i^{Af)) = 0, 

where Am = (a(i,j)Xp(j,j)<x)jjeA^ is the band-limited truncation of A = {a{i,j))ij^j^ G 
A, and p is a distance function on M x Af with supjg_yy^ #{j G Af : p{i,j) < "m} < oo 
for all m > 1. We remark that (13. ip is invalid for the classical Schur class 

S := {(a(i,j))i,iez : sup V|a(i,j)| + sup V |a(i, j)| < ooj. 

Given (3 > d and a relatively-separated subset A of M°', we notice that the JafFard 
class J^/siA) is a Banach subalgebra of B{i^{A)) for all 1 < p < oo, and also that (13. ip 
holds by letting A/'m = {A G A : |A| < 2™},?Ti > 1. Therefore a strictly monotonic 
function / on £^(A) with continuous bounded gradient in the Jaffard class J7^(A) 
can be extended to a continuously invertible function on i^{A), 1 < p < oo. 

Corollary 3.2. Let (3 > d,A be a relatively-separated subset ofM."^, and let f be 
a strictly monotonic function on £^(A) such that /(O) = and the gradient V/ 
is bounded and continuous in Jj^[A). Then the function f can be extended to a 
continuously invertible function on i^{A), 1 < p < oo. 



To prove Theorem 13.11 we need a technical lemma about the extension of a func- 
tion on £'', 1 < g < oo, which is not necessarily strictly monotonic. 

Lemma 3.3. Let 1 < q < oo, M be a countable index set, Abe a Banach subalgebra 
of B{&{N')), and f be a continuous function on i'^{Af) such that /(O) = and its 
gradient V/ is bounded and continuous in A. Then 

(i) the function f can be uniquely extended to a continuous function F on P'{N') 

if 1 < p < oo and A is a Banach subalgebra of B{i^{N')); and 
(ii) the function f can be uniquely extended to a continuous function F on 
i°°{M) with respect to the weak-star topology if A is a Banach subalgebra 
ofB{e'^{Af)) and satisfies ^Ih . 

Furthermore the extension F satisfies the uniform Lipschitz condition (13.20 . 
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Proof, (i) Given x G £^ := i^i^M),! < p < oo, take a Cauchy sequence x„ G 
i^ r\i'^,n > 1, that converges to x in i^ and satisfies Xi = 0. For any x', x" G £^ fl f"^, 



ll/(x')-/(:r" 



( I Vfisx' + (1 - s)x")rfs) {x' - x"] 
< ( sup \\Vf{sx' + {1- s)x")\\B(^ep))\\x' -x"\ 



0<s<l 



(3.4) 



< (sup||V/(2;)|U)( sup P||b(^p))||x'-x"||p. 

zeei ll-4|U<i 



Thus f{xn),n > 1, is a Cauchy sequence in i^. Denote the hmit of f{xn),n > 1, 
by F{x); i.e., F{x) := lim„_s.oo /(a^n) in £^. This together with (13. 4p iniphes that 
the function F on i^ is a continuous extension of the function / on £'' and satisfies 
the uniform Lipschitz condition (13. 2p . Furthermore such a continuous extension is 
unique due to the density of l^ fl £'' in i^. 

(ii) Let Pm,'m > 1, be as in Theorem 13.11 For every m > 1, 



|Pn^/(x)||oo < ||/(X)-/(0)|U< / \\Vf{sx)x\\^ds 



(3.5) 

for X E i'^, and 



< (sup||V/(2;)|U)( sup p||f5(£oc))||a;||oo 
z&ei l|A|U<i 



(3.6) 



Pmf{x)-Pmfix')\\^ 
[ PmVfisX + (1 - S)x'){l - Pk){x - X')ds 

Jo 

< (sup||V/(;2)|U)( sup \\PmA{I-Pk)\\ts{io^))\\x-x'\ 
z&ei II^IU<i 



for all X, x' G i'^ with P^x = Pkx' . The above two estimates together with (13.11) imply 
that Pmf{Pnx),n > 1, is a Cauchy sequence in £°° for every x G £°° and m > 1. 
Denote the limit of the above Cauchy sequence by F^ix). Clearly Pm'Fm{x) = 
Fm'{x) for all sequences x E i°° and integers m' and m with 1 < m' < m. This 
imphes that there is a unique sequence, to be denoted by F{x), such that 

(3.7) PmF{x) = Fm{x) for all a; G £~ and m > 1. 

The function F is well-defined on i°° with -F(O) = because 

\\F(x 



oo = sup lim ||Pm/(P„a;)||oo < (sup||V/(2;)||^)( sup ||A||b(^oo)) | 



x\ 



by ([33]). Moreover, by ([33]), ([33]) and (l3Tll . 

(3.8) F{x) = fix) for all x G £«; 



(3.9) ||F(a;)-F(x')||oo<(sup||V/(z)|U)( sup ||A||b(^oo)) ||x - x'| 

^6^" II^IU<1 
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for all X, x' G £°^; and 

||P^F(x)-P„F(P„x)|U < ( sup \\P„.-iA{I - P^)\\isie^)] 

\\A\\a<1 



(3.10) x(sup||V/(^)|U)| 



,x\ 



oo 



■ ze£i 



for all X & i°^ and ?ti < ra — 1. Denote by (•, ■) the action between sequences in i^ 
and i'^. From ([S3D, dSSD and fIXTUD it follows that 

\{y,Fix))~{y,F{x'))\ 

< ll(/-^n.)?/||l(l|i^(^)l|oo+||P(x')||oo) 

+ ||P„l/||i(||P^F(x) - P^P(P„+ix)|U 
+ ||P„P(x')-PmP(Pm+ia;')||oo) 

+ \\Pmy\\l\\PmF{Pm+lX) - P^P(P„+ix') ||oo 

(sup||V/(z)|U)(||?/||i sup ||P„A(/-P, 



< 



\\A\\a<. 



+ ||(/-P„)y||i sup ||yl||i3(£oo))(||x||oo + ||a;'||oo) 

\\A\\a<1 ^ 

(3.11) +(sup||V/(2;)|U)( sup p||e(^oc))||y||i||P„,+i(a;-x')||oo 

zeei \\a\\a<i 

for all y G i^,x,x' G i°° and m > 1. This together with the off-diagonal decay 
assumption (13. ip proves the continuity of the function F with respect to the weak- 
star topology. Thus F is an extension of the function / on £^ which is continuous 
with respect to the weak-star topology and satisfies the uniform Lipschitz condition 
(13.21) . The uniqueness of such an extension follows from the fact that £°^ fl i'^ is dense 
in i°° with respect to the weak-star topology. D 

Proof of Theorem \3.1[ Let F be the unique extension of the function / to P' in 
Lemma [3731 Then F satisfies (13. 2p by Lemma [3731 By Theorem 12. 11 V/~^ is contin- 
uous and bounded in A. Applying Lemma [373] to the function f~^ on (? leads to the 
unique extension G of the function f~^ to &'. By Lemma [3. 3[ G is the continuous 
inverse of the function F on P' that satisfies (13. 3p . because iP r\(,'^ is dense in dP with 
respect to the strong topology if 1 < p < oo and the weak-star topology of £°° if 
p = oo. D 

4. Invertibility 

In this section, we apply the unique Lipschitz extension theorem (Theorem 13. ip 
established in the previous section, and show that the restriction of a function / on 
£°° to £^ C £°°, 1 < p < oo, is invertible on £^ if its gradient V/ is bounded and 
continuous in some Banach algebra and has the strict monotonicity property (14. ip . 

Theorem 4.1. Let 2 < pq < oo, A be a subalgebra of B{i'^) for all 1 < q < oo with 
the property that it admits norm control in B{1'^) and satisfies (13. ip . Assume that f 
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is a continuous function on f^" such that f{0) = 0, its gradient V/ is bounded and 
continuous in A and satisfies 

(4.1) c^Vf{x)c > moc^c for all c e f and a; € £p° 

where mo > 0. Then 

(i) for every I < p < po, the restriction of f to i^ is a continuously invertible 
function on (P and the gradient of its inverse is hounded and continuous in 
A; and 

(ii) for every Po < p < oo, the function f can be extended to a continuously 
invertible function F on i^ that satisfies 



(4.2) ||F(a;)-F(x')||p< (sup ||V/(z)|U)( sup P||b(,p)) ||x - 



1 F{x) - 


n^')\p 


< 


(sup |V/(z)U)( sup 

zGlPo ||A|U<1 


and 










\F-\x)- 


-F-\x 


ou 


, < ( sup 

zeP'o 


ivr^(^)iu)( 


for all X, x' 


' eiP. 









X 



(4.3) \\F-\x)-F-\x')\\,<{snp\\Vf-\z)\U){ sup \\A\\siir>))\\x 

ll^lU<i 



We do not know whether or not the conclusions in the above invertibility theorem 
hold when 1 < po < 2. Taking p = pq in Theorem 14.11 leads to the following 
generalization of the well known result for invertibility of a function on i"^, see 
[69] or Lemma [2.31 



Corollary 4.2. Let 2 < p < cxo, and A be a subalgebra of B{i'^) for all 1 < q < oo 
with the property that it admits norm control in B{(?) and satisfies (13.11) . // / is 
a continuous function on i^ such that /(O) = 0, its gradient V/ is bounded and 
continuous in A and satisfies 

c^V f{x)c > rrioc^c for all c G i"^ and x G F, 

then f has continuous inverse in dP and the inverse f~^ has continuous bounded 
gradient in A. 

Remark 4.3. Applying Corollary 14. 21 to a linear function f{x) = Ax, where A is an 
infinite matrix in A, we conclude that if A is positive definite, i.e., Cil < A < C2I 
for some positive constants Ci and C2, then A has bounded inverse in S(£^) for all 
1 < p < oo. The above result follows from Wiener's lemma for infinite matrices 
in A if we assume further that A is closed under transpose operation and has the 
identity I as its unit [6l[2ll[23l[2l[26l[371|55l|60l[63]. 

Taking the Jaffard class Jp{h) as the Banach algebra A in Theorem 14. H we obtain 

Corollary 4.4. Let P > d,A be a relatively-separated subset of M."^, and let f be a 
continuous function on i°° (A) such that /(O) = 0, and its gradient V/ is bounded and 
continuous in Jj3{h) and satisfies (14. ip . Then for every 1 < p < 00, the restriction 
of f to &'{h) is a continuously invertible function on £^(A), and the gradient of its 
inverse is bounded and continuous in Jpi^A). 
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Proof of Theorem \4.1\ (i) First we prove that for every 1 < p < po the restriction 
of the function / on i^, denoted by Fp, is well-defined. Let Pm,'^ > 1, be as in 
Theorem O Take x e i^ C P\ then P^/(x) G f^ and 

||P^/(x)||p = \\Pmf{x)-Pmf{mp< I \\PmVf{sx)x\\pds 

Jo 

(4.4) < ( sup ||V/(2;)||b(,p))||x||p for all m > 1, 

which implies that 

||/(x)||p = sup ||Pm/(x)||p < ( sup ||V/(2;)|U)( sup ||A||6(£p)) ||x||p 

m>l ze^Po ||A|U<1 

for all X G £^. Thus the restriction of / on i^ is well-defined. 

Next we prove that for every 1 < p < po, the function Fp is continuous on i^ and 
has continuous bounded gradient in A. Similar to the argument in (14.41) . we obtain 

||Pp(a;')-Pp(x)||p< (sup ||V/(2;)|U)( sup \\A\\s^fP))\\x - x'\\p 



^ee^o \\A\U<i 



and 



\\Fp{x')-Fp{x)-Vfix)ix'-x)\\p<{ sup WAWsiiP)) 

x( sup ||V/(x + s(x' — x)) — V/(x)m) ||x — x'llp 

0<s<l 

for all X, x' G dP. This implies that Fp is continuous on l^ and 

(4.5) VFp{x) = V/(x) for all 1 < p < po. 

Hence Fp has its gradient VFp{x) in A. The continuity of VPp(x), x G i^, in A then 
follows from the continuity of the gradient V/(x), x G £^°, in A and the continuous 
embedding of i^ in £^° for every 1 < p < po- 

Then we prove the continuous invertibility of the function Fp on £p, 1 < p < 
Pq. We notice that the function F2 satisfies all requirements for the function / 
in Theorem 13.11 because it has continuous gradient in A and strictly monotonic 
property by (14.11) . (14. 5 p and the assumption po > 2, and it satisfies P2(0) = by the 
assumption /(O) = 0. Thus by Theorem 13.11 it suffices to show that the function Fp 
is a continuous extension of the function P2 on (P with respect to the strong topology 
when 1 < p < 00 and the weak-star topology when p = 00. The above extension 
property follows as both F2 and Fp are the restriction of the function / on &'° . The 
continuity of the function Fp with respect to the strong topology when 1 < p < 00 
follows as Fp is continuous on C.^. To establish the continuity of the function Fp with 
respect to the weak-star topology when p = 00, we notice that Pq = 00 and Fp = f 
in this case. Moreover for p = 00, similar to the argument used to establish (13. lip 
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we obtain 



\{y,F,{x))-{y,F,{x'))\ 



< ( sup ||V/(z)|U)(||y||i sup \\P„A{.I - Pm+l)\\B{i^) 
26£°° ^ I|A|U<1 



+ \\{I - Pm)y\\i sup ||A||e(^oc))(||x||oo + ||a;'||oo) 
II^IU<i ^ 

+ ( sup ||V/(2;)|U)( sup ||v4||6(^oo))||y||i||P„+i(a;-a;')||oo 

for all y & i^,x,x' & i^ and m > 1, which implies that Fp is continuous on i°° with 
respect to the weak-star topology. 

Finally we prove that for every 1 < p < Po, the inverse of the function Fp has its 
gradient being bounded and continuous in A. Take x G i^, and let x„ G i^ni"^, n > 1, 
converge to x with respect to the strong topology of £^ when 1 < p < oo and the 
weak-star topology of i°° when p = oo. Recall that the function Fp is a continuous 
extension of the function F2 on i^ with respect to the strong topology when 1 < p < 
cxD and the weak-star topology when p = 00. Then 

lim J{F2{xn + tc) - F2{Xn)) = c^ {Fp{x + tc) - Fp{x)), 

where t G M and c ^ i^ (the space of all finitely supported sequences). This together 
with (H?T1) and (gSD implies that 

c^VFp{x)c = \imt~^J{Fp{x + tc)- Fp{x)) 

= lim lim r^J{F2{xn + tc) - F2(a;„)) 



lim lim / c"^V-F2(x„ + stc)cds > niQC^ c for all c & i^ . 



Thus 



c^VFp{x)c > rrioc^c for all c G i'^ and x G F 

by (14.11) . (14.51) . the density of £° in i"^, and ^ is a Banach subalgebra of B{(?). Hence 
VFp{x) is invertible on (? and ||(VFp(a;))~-^||g(^2) < l/rriQ for all x G (P. Notice that 
VFp{x),x G P', is bounded and continuous in A by (14. 5 p and the assumption that 
V/(x), X G £^°, is bounded and continuous in A. Then we obtain from the inverse- 
closedness of the subalgebra A in B{(?) that (VFp)~^ is bounded and continuous 
in A. This together with (12. 4p proves that the gradient V(-F~^) of the inverse 
function F'^ is bounded in A. The continuity of V(Fp~^) in A follows from (12.40 . 
the continuity of V Fp in A and the boundedness of V{Fp^) in A. 

(ii) We recall that the function F2 satisfies all requirements for the function 
/ in Theorem 13. 1[ Then by Theorem 13.11 there exists a unique extension F of 
the function F2 on dP ^2 < p < 00^ which is continuous with respect to the strong 
topology of P' when 1 < p < 00 and the weak-star topology of P when p = 00. 
As shown earlier, -Fp, 2 < p < Po, are the restriction of the function / on P'^ and 
are continuous with respect to the strong topology of P when 1 < p < 00 and the 
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weak-star topology of £^ when p = oo. Hence F = Fp when 2 < p < pq, which in 
turn imphes that for Po < p < oo, the function F is a continuous extension of the 
function / on i^". The Lipschitz conditions (14 ■2p and (14. 3p for the function F follow 
from (12 ■4p , Theorem 13.11 and the inclusion i"^ G i^°. D 

5. Error estimate 

In this section, we apply the invertibility theorem (Theorem 14.10 established in 
the previous section, and discuss the £^-error estimate for solving the nonlinear 
functional equation (II. ip in the presence of noises in £^, 1 < p < oo. 

Theorem 5.1. Let 2 < pq < oo, 1 < p < Po, A be a suhalgehra of B{^'^) for all 
1 < g < oo with the property that it admits norm control in B{1'^) and satisfies 
(13. ip . and let f he a continuous function on i^° such that /(O) = 0, its gradient V/ 
is bounded and continuous in A and satisfies (14. ip . If xq and x^ are the solutions of 
the nonlinear functional equation (II. ip from the noiseless observed data y & P' and 
the noisy observed data y + e in (P respectively (i.e., /(xq) = y and f{xe) = y + e), 
then 



(5.1) \\xe-xo\\p< {snp \\Vf ^{z)\\_a){ sup ||v4||b(^p)) | 

z&m ||^IU<i 

and 



IP) 



p 



(5-2) — 7. — 7 </t^(/)( sup PIIb(^p)) —- , 

IfoIIp I|A|U<i II2/IIp 

where n^if) = (sup^^^po II V/(2;)|U) (sup^g^po ||V/"^(2;)|U) . 

Remark 5.2. If ^ = i3(^^) and / is a linear function on i^° (i.e, f{x) = Ax for 
some matrix A), then Kj^{f) in Theorem 15.11 becomes the condition number for the 
matrix A. So the quantity fi;^(/) can be thought as the condition number of the 
function / in the Banach algebra A. 

Remark 5.3. Estimates in Theorems 13. H H?T] and [5Jl could be improved by replac- 
ing the ^-norm by the conventional B{i^)-noTTCi. For instance, we can replace (15. ip 
and (I5.2p in Theorem 15.11 by the following better estimates: 

(5.3) \\x, - XqWp < ( sup ||V/"^(2;)||e(£P)) 

and 



... P' 
eepo 



(5.4) M^^ < ( sup ||V/(^)|b(,.))( sup \\Wf-\z)\\tsier.))Pf- 

IFoIIp zee^o zeipo WVWp 

We select the suboptimal estimates in Theorems 13 . H l^?T] and |5TT] for emphasizing the 
fundamental role the inverse-closed Banach algebra A has played, and for increasing 
computational feasibility, c.f. the arguments used to prove Theorems 16. H 17.11 and 
18.11 On the other hand, the replacement of ^-norm by the ordinary S(£^)-norm does 
not always work well. In our study of global linear convergence of the Van-Cittert 
iteration method (Theorem 16. ip . we cannot replace the ^-norm in (16. lip by the 
ordinary ;B(£^)-norm. The reasons are that the differential norm property (12. 2p does 
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not hold when A is replaced by B{i^),p ^ 2, and that the new 6j with the ^-norm 
replaced by the ;B(£P)-norm may not satisfy the crucial iterative properties ( I6.12p 
and fl67[3|) . 

Remark 5.4. The mean squared error, as a signal fidelity measure, is widely criti- 
cized in the field of signal processing for its failure to deal with perceptually impor- 
tant signals such as speech and images. An interesting alternative is the £P-norm 
with p 7^ 2, possibly with adaptive spatial weighting, see the recent review paper 
[67] on the signal fidelity measure. This is one of our motivations to consider solving 
the nonlinear functional equation (11. ip in the presence of noises in P* with p ^ 2. 

Proof of Theorem \5.1\ By Theorem 14. ![ the function / is invertible on P' and hence 
the nonlinear functional equation fll.ip is solvable m. CP,1 <p < pq. Thus x, x^ G i^. 
Again by Theorem 14. ![ the inverse of the function / on i^ has its gradient bounded 
and continuous in A. Thus 

\\r\yi) - r\y2)\\p < (sup ||vri(^)|U)( sup WAUie^^Myi - y2\\p 

zeepo II^IU<i 

for all 2/1,2/2 £ ^^- Applying the above estimate with yi, y2 replaced hy y,y + e E P' 
proves the absolute error estimate (15. ip . 

Using the above argument with the function /^^ replaced by the function / leads 
to 

(5.5) ||/(a;i) -/(x2)||p < ( sup ||V/(2;)|U)( sup ||v4||b(^p)) ||a;i - a;2||p 

zemt imu<i 

for all Xi, X2 G P . Taking Xi = Xq and X2 = in (15. 5p and using /(O) = gives 
(5-6) ||2/||p= ||/(a;o)||p < ( sup ||V/(2;)|U)( sup P||b(^p)) ||a;o||p. 

z&iPO \\A\\a<1 

Hence the relative error estimate (15. 2p follows from (15. ip and (15. 6p . D 

6. Convergence of iteration methods 

In this section, we consider numerically solving the nonlinear functional equation 
(II. ip . We show in Theorem 16.11 that the Van-Cittert iteration method has global 
exponential convergence in P, and in Theorem 16.41 that the quasi-Newton itera- 
tion method has local quadratic convergence in £^, 1 < p < oo. The Van-Cittert 
method is the only iteration method, that we found, which has global exponential 
convergence in P,p ^ 2, for solving infinite-dimensional nonlinear functional equa- 
tion (II. ip . We are seeking to derive other iteration methods to solve the nonlinear 
functional equation (II. ip . that are easily implementable and stable in the presence 
of noises, and that have global (or local) convergence in P with p ^ 2. 

6.1. Global linear convergence of the Van-Cittert iteration method. 

Theorem 6.1. Let 2 < po < cxd, and let A be a Banach algebra of infinite matrices 
with the property that it is a subalgebra of B{P) for all 1 < q < oo, it contains the 
identity matrix I , it is closed under the transpose operation, and it satisfies (13. ip 
and the differential norm inequality (12. 2p for some Cq G (0, oo) and 9 G [0,1). 
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Assume that f is a continuous function on £^" such that /(O) = 0, its gradient 
V/ is bounded and continuous in A and satisfies the strict monotonicity property 
(14.11) . Set L = sup^g^po II V/(-2)||b(£2) and let tuq he the strict monotonicity constant 
in (14.11) . Given 1 < p < Po and y G £^, take an initial guess Xq G i^ and define 
Xn & i^,n> 1, iteratively by 

(6.1) Xn = a;„_i - a(/(x„_i) -y), n> 1. 

Then for any < a < mQ/{L + L"^), the sequence x„, ra > 0, converges exponentially 
in &' to the unique true solution f^^{y) of the nonlinear functional equation (II. ip . 
Moreover 

(6.2) \\xn-f-\y)\\p<Ci\\xo-f-\y)\\pr\ n>0, 

wherer > (1 — a + a;^L + a;^L^)/(l — a + amg) andCi is a positive constant depending 
only on a, r, p and A. 

Remark 6.2. We may rewrite the Van-Cittert iteration (16. ip as x„ = Txn-i, where 
Tx = X — a{f{x) — y),x G i^. Thus the Van-Cittert iteration (16. ip is a Picard 
iteration to solve the nonhnear functional equation (II. ip . The logic behind the 
Van-Cittert iteration (16. ID is that we define the new guess by adding the difference 
y — /(xo) weighted by a relaxation factor a to the initial guess xq if the difference 
y — fi^o) between the observation /(xq) of the initial guess xq and the observed 
data y is above a threshold, and we repeat the above iteration until the difference 
between the observation of the guess and the observed data is below a threshold. 
The Van-Cittert iteration (16.11) can be easily implemented and is fairly stable in the 
presence of noises in i^, see Section PT^ for numerical simulations. 

It has been established in [5Sl ED] that the Jaffard class i7^(A) in (12.30 satisfies 
the paracompact condition (12.51) . We can mimic the proof there to show that the 
Jaffard class ^7/3 (A) satisfies the differential norm inequality (12. 2p . Then we have the 
following corollary by Theorem 16.11 

Corollary 6.3. Let P > d,A be a relatively- separated subset o/M'^, and letpQ,p, /, L, a 
be as in Theorem \6.1\ with the Banach algebra A replaced by the Jaffard class J'^IA). 
Then the sequence Xn,n > 0, in the Van-Cittert iteration (16. ip converges exponen- 
tially in £^(A) to the true solution of the nonlinear functional equation (II. ip with 
the observed data y. 

Proof of Theorem \6.1\ By Proposition l2.4t A is an inverse-closed Banach subalgebra 
of B{f') that admits norm control. This together with Theorem 14. II implies that / 
is invertible on P*. Hence x* := f~^{y) G i^. For the Van-Cittert iteration (16.10 . 

X„+i-X* = {l-a){Xn-X*) +a{Xn+i-X* - f{Xn+l) + fix*)) 
-a{Xn+l -Xn- f{Xn+l) + f{Xn)) 
= (1 - a){Xn - X*) + a[Xn+l -X* - f{Xn+l) + f {x*)) 

W{f{Xn) - fix*)) +a(^f{Xn - a{f{Xn) - f (x*))) - /(x„)) . 
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This leads to the following crucial equation: 

(6.3) An{Xn+l — X*) = Bn{xn — X*) for all n > 0, 



where 

(6.4) 

and 

(6.5) 



An= {l-a)I + a / Vf{tXn+i + (1 - t)x*)dt, 
Jo 

Bn = {l-a)I + a^{l- j Vf{xn-sa{f{xn)-f{x*)))ds 
x( Vf{tXn + (1 - t)x*)dt\ , n > 0. 



(6.8) \\A-^B4riiP) = -, — ^L := ri < 1 



For infinite matrices A^ and i?„, ri > 0, we obtain from (14. ip . (16. 4p and (16. 5p that 

r P„||b(,2)<1 + (L-1)«, 

(6.6) < P„|U < (1 -a)||/|U + asup^g^Po ||V/(z)|U, 
y c^AnC > (1 — a + amo)c^c for all c G £^, 

and 

f \\Bn\\B(e^) <l-a + a^L{l + L), 

(6.7) <^ ||5„|U<(l-a)||/|U + a2(sup,g^^J|V/(2;)|U) 
[ x(||/|U + sup,,,.o||V/(^)|U). 

For every n > 0, it follows from (16.61) that An is invertible in i"^ and the operator 
norm ||(A„)~-'^||g(£2) of its inverse {An)~^ is bounded by (1 — a + amg)"^. The above 
property for infinite matrices An,n > 0, together with (16. 7p and the norm control 
property of the Banach algebra A given in Proposition 12.41 implies that 

1 — a + aniQ 
and 

(6.9) \\A-'^Bn\\A<Di<oo foralln>0, 

where Di is a positive constant independent of n > 0. 
Now we rewrite (16.31) as 

Xn+l X /in ^n\Xn X j. 

Applying the above formula iteratively gives 

Xn+l -X* = A-^BnA-\Bn^i ■ ■ ■ A^^ Bq{xq - X*). 

Then the proof of the exponential convergence of x„, n > 0, to x* reduces to showing 
that there exist positive constant C G (0, +oo) and r G (0, 1) such that 

(6.10) \\A;^^BnA-\Bn-i---A-^^B4j,<Cr\ n > 0. 
For e G (0,1), set 

(6.11) h, = (2Co)^/Vsupl|AT^ViS.+fc-i--- V^felU, 

fc>0 



22 QIYU SUN 

where Co and ri are the constants in (12. 2p and (16.81) respectively. Then we obtain 
from (16. 8p . (16. 9 p and the differential norm property (12. 2p that 

k>0 

< i2CoY'^'^/'rf^ max (P^^i^^.+.-i ■ • • Ajl,B,^,\\\^\ 

II 4-1 R /l-l R l|l+^^ 

W^j+k-l^j+k-l ■■■^k ^felU j 

X max (||A2j+fc_i52j+fc_i ■ • • Ajlf^Bj+k\\]f(^i2y 

II 4-1 R 4-1r 111-" ^ 

ll^i+fe-i-°i+'=-i ■ ■ '"^fe -"fcllB(£2)J 

(6.12) < b]+' 

and 

&2i+l < (2Co)^/Vi ^ sup ||A2/+fci?2j+A:|U||^2i+fc-1^2i+fe-l- ■■^fc^^felU 

fc>0 

(6.13) < {D^/r^)h,<{D^/r^)b]^' 

for all j > 1. Applying (16.120 and (I6.13P repeatedly yields 

b. < {D,/rr%'^f ,,„,<---<Pi/r)S--(^+^)"6(;+^)' 

< (Z}i/r)(i+^)'/^((2Co)^/'/^i/r)(i+^)' < {2CoDr/nf^+'^^'°''''''''' /\ 
where n = J2i=o^i'^^ with e^ G {0, 1} and ei = 1. Therefore for 9 G (0, 1), 
\\A-'B^A-'_,B^_,---A^'Bo\U < {2Co)-'"r^,bn 

(6.14) < {2Co)-'/\l{CoD^/nf^+'^-''"'''^''" 

for all n > 1. 

For ^ = 0, we can mimic the above argument to obtain that 

(6.15) \\A-^BrA--iBn-i ■ --A-^'BoU < <(2Co/^i/ri)i+'°S2" for all n>l. 

Hence (I6.10p follows from (I6.14p and (I6.15P by letting r G (?"i, 1), and the exponential 
convergence of x„ in P' is established. D 

6.2. Local quadratic convergence of the quasi-Newton method. In this 
subsection, we show that the quasi-Newton iterative method (16.17P has local R- 
quadratic convergence in i^. 

Theorem 6.4. Let 2 < pq < oo, let A be a subalgebra of B{i'') for all 1 < q < oo 
and an subalgebra of B{i^) that admits norm control, and satisfy (13. ip . and let f 
be a continuous function on (!P° such that /(O) = 0, its gradient V/ is bounded and 
continuous in A, and satisfies the strictly monotonic property (14. ip and 

(6.16) ||V/(x) - V/(x')|U < Ci\\x - X ||p„ for all x,x' G ff'" 

where Ci G (0, oo). Given an observed data y & (P and an initial guess xq G f^, 1 < 
P ^ Po, define the quasi-Newton iteration by 

(6.17) Xn+1= Xn- (yf{Xn))~^{f{Xn) -y), U > 1. 
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Then Xn,n > 1, converges R-quadratically to the solution f^^{y) of the nonlinear 
functional equation ( II .ip with the observed data y as there exists a positive constant 
C such that 

(6.18) ||a;n+i -a;„||p < C||s„ -s„_i||p for all ra > 1, 

•provided that the initial guess Xq is sufficiently close to the true solution f^^iy). 

By Theorems 14.11 and 16.41 we have the following corollary. 

Corollary 6.5. Let /3 > d,A be a relatively-separated subset of'R'^, A be the Jaffard 
class j7a(A), and letpo and f be as in Theorem\6.4\ Then the quasi-Newton iteration 



( I6.17P has local R-quadratical convergence in i^,l < p < po- 
Proof of Theorem \6.4\ By f l6.16p and fl6.17p . 

Iki -xollp < ( sup ||(V/(2;))"^|U)( sup \\A\\is(ep))\\fixo)-y\\p 
zeipo II^IU<i 

and 

||a;„+i -x„||p = \\{Vf{xn))~^{f{xn)-y)\\p 

< (sup ||(V/(z))-i^)( sup P||b(£p)) 

z&epo \\A\u<i 

X||/(X„) - f{Xn-l) - V/(x„_i)(x„ -Xn-1 



< Ci( sup ||(V/(2;)) ^|U)( sup \\A\\ts(ep))\\Xn-Xn-l 

zeiPo l|A|U<i 



p 

2 
P 



for all n > 1. This proves the local R-quadratic convergence of the quasi-Newton 
iteration method. D 

7. Instantaneous companding and average sampling 

In this section, the theory established in previous sections for the nonlinear func- 
tional equation (11. ip will be used to handle the nonlinear sampling procedure (ll.7p 
of instantaneous companding and subsequently average sampling. In the first sub- 
section, we apply the invertibility theorem (Theorem 14.11) to establish ^^-stability 
of the nonlinear sampling procedure (11.70 . while in the second subsection we use 
the Van-Cittert iteration method in Theorem 16.11 and the quasi-Newton iteration 
method in Theorem 16.41 to recover signals from averaging samples of their instanta- 
neous companding. We present some numerical simulations in the last subsection 
to demonstrate the stable signal recovery in the presence of bounded noises. 

7.1. £^-stabiIity of the nonlinear sampling procedure (11.70 . We say that $ = 
(0A)AeA is a Riesz basis for the space Vp{^) in (II. 9p if 

(7.1) < inf ||c^$||p < sup ||c^$||p < oo. 

I|c!lp=l ||c||p=l 

Given two closed subspaces V and W of L^, define the gap 6(y, W) from V to W hj 

(7.2) S{V,W) = sup inf ||/i-/i||2 = sup \\h - Pwhy, 

\\h\\2<l,heV hew ||^||2<l,/»Gy 
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where Pw is the projection operator onto W. 

Theorem 7.1. Let A, F be two relatively- separated subsets 0/ M*^, and let $ := 
(0A)AeA ^'iT'd \1/ := {ip-y)-yi^r have polynomial decay of order (3 > d, i.e., 

sup |0(x)|(l + |x- A|)'^ + sup |-?/'^(x)|(l + |x -7!)^ < 00, 
AeA.xeM'' 7er,xeRrf 

and generate Riesz bases for V2{^) andV2{'^) respectively. If the gap S{V2{^),V2{'^)) 
from V2($) to V2(\l/) is strictly less than one, and the companding function F is a 
continuously differential function on R satisfying F{0) = and 



(7,3) ,:=sup\l-mF(t)\< V^ - (HV.m.VmW 



sm-i), vy*)) + vi-wv2(*).i'2(*)))' 

/or some nonzero constant m, then the nonlinear sampling procedure Sp,^ in fll.7p 
is stable on l^($), 1 < p < c>o, i.e., there exist positive constants Ci and C2 such 
that 

(7.4) Ci\\hi - h2\\p < \\SF,^{hi) - SF,^{h2)\\p < C2\\hi - h2\\p 

for all hi,h2 e Vp{^). 



Remark 7.2. We remark that, in Theorem 17.11 the assumption that the gap 
(5(V2($), V2(\[^)) from V2($) to V2(\l/) is strictly less than one is a necessary and 
sufficient condition for the £^-stability of the sampling procedure (11.71) without in- 
stantaneous companding (i.e., F{t) = t) on V2($). The above equivalence follows 
from (17. 6p . (17. 8p and (I7.12p . For the sampling procedure (II. 7p without instantaneous 
companding, the readers may refer to [H [59] and references therein. 

As a stable nonlinear sampling procedure is one-to-one, from Theorem 17.11 we 
obtain the uniqueness of the nonlinear sampling procedure (11.71) . which is established 
in [19] for p = 2 when /x < i+j(y (,^)'y l^)) ? ^ stronger assumption on F than (I7.3p in 
Theorem 17. 1[ 



Corollary 7.3. Let $, \1' and F be as in Theorem \7.1\ Then any signal h G 



Vp{^), 1 < p < 00, is uniquely determined by its nonlinear sampling data {F{h), \1'). 

Notice that 6{V, V) = for any closed subspace V of L^. Then applying Theorem 
17.11 with the generator $ of the space V2($) being taken as the average sampler \E' 
in the nonlinear sampling procedure (II. 7p . we obtain the following result. 

Corollary 7.4. Let A be a relatively-separated subset ofW^, and let $ := {(t)\)\eA 
have polynomial decay of order (i > d and generate a Riesz basis for V2($). // the 
companding function F has its derivative bounded away from zero and infinity, then 
the nonlinear sampling procedure Sp^q, in (II. 7p with \& = $ zs stable on V^($), 1 < 

p < CXD. 
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Remark 7.5. Notice that 

(infF'(s))||ci-C2||^ < (ci-C2)^(5^,$(cf$)-5i.,$(c^<l>)) 

(F(cf$(t)) - F(4$(t)))(cf$(t) - c^^t))dt 
< (supF'(s))||ci-C2||^ 



for all Ci, C2 G V2($). Hence the stability conclusion in Corollary 17.41 holds for p = 2 
without the polynomial decay assumption on $. This is established for signals living 
in the Paley- Wiener space [IHl ES] or a shift-invariant space 



Given relatively-separated subsets A and F, let the Jaffard class j7/3(r,A) be the 
family of infinite matrices A := (0(7, A))^gr,AeA such that 

||^IU,{r,A) := sup (1 + |7 - A|)^|a(7, A)| < 00. 

76r,A 

Given two vectors $ := (0A)AeA and \E' := {ip'r)'y£r of square-integrable functions, 
we define their inter- correlation matrix A^^^ by A$^^ = {{(p\,i''r)) ^^j^ ^p- To prove 
Theorem I7.H we need a technical lemma. 

Lemma 7.6. Let A, F be relatively-separated subsets ofM.'^, $ := (0A)AeA o'^^ ^ •= 
{ip^)^^r have polynomial decay of order 13 > d and generate Riesz bases o/V2($) and 
V2(\E') respectively, and let the function F satisfy F{0) = and have its derivative 
being continuous and bounded. Then 

(i) $ and \E' generate Riesz bases for Vp{^) and Vpl"^) respectively, where 1 < 

p < 00. 
(ii) The function /f,#,* in fll.lOp is well-defined on (P for all 1 < p < 00, and 
has its gradient V/f$^ being continuous and bounded in the Jaffard class 

Mr, A). 



Proof, (i) We follow the arguments in [HI] . By the polynomial decay property for 
$ and relatively-separatedness of the index set A, we have that 

(7.5) sup ||c^$||p < 00. 

||c||p=l 

By Riesz basis property for V2($) and the polynomial decay property for $, 

(7.6) (A$,$)-^ G B{f{A)) and A$,$ G Jfs{A). 

Hence (A$^<j,)~^ belong to the same Jaffard class J7/3(A) by the inverse-closedness 
of the Jaffard class Jp{A) in B{(?{A)), which together with the polynomial decay 
property of $ implies that the dual Riesz basis (^4$^$)"^$ has the polynomial decay 
of same order /3. Hence c = (c^$, (A$^<j,)~^$) for all c G dP, which yields 

(7.7) inf ||c^<l>||p>0. 

||c||p=l 

Combining (17. 5p and (17.71) proves the Riesz property for V^($). 
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The Riesz property for V^(^I/) can be proved by using the same argument to 
estabhsh ( I7.5p and f l7.7p except with $ replaced by \1/, A by F, fl7.6p by 

(7.8) {A^,^)~^ e B{f{T)) and A^^^ G Jp{T), 

which follows from Riesz basis property for V2(\&) and the polynomial decay property 
for \E'. 

(ii) For c = {c{X))xeA G ^^A), write fF,<s>,M = {dh))^er. Then 



\d{l)\ < / \F{J<l>{t))^,{t)\dt 

< ||i^'||oo||$||oo,;3||^||oo,;3V|c(A)| / {l + \t-X\)-^{l + \t-^\)-^dt 

< C||F'|U||$||oo,/3||^||oo,/3 5^|c(A)|(l + |A-7|)-^ forall7eF, 



AeA 



where C is a positive constant. Thus /f,$,<^(c) G £^(F) for all c G ^^(A), which proves 
that the function /f,#,* is well-defined on ^^(A). 
By direct calculation, we have that 

(7.9) V/p,$,^(c) = ((F'(c^$)0A, V'7))7er,AeA for all c G F, 

and limc_s.c in ip \\c^^ — c^^\\oo = 0. Thus VfF,'i>,'S>{c), c G i^, is bounded and contin- 
uous in J7^(F, A), n 

Proof of Theorem \ 7. 1\ By the polynomial decay property for $ and \E', A$^$ G 
j7'/3(A,A),A,i,,vi, G J'/3(F,F),AvE,,$ G J'/3(F,A) and A$,ve, G J'/3(A,F). From the ar- 
gument in Lemma fL6\ we have that {A<^^<s,)^^ G J'p{A,A) and (A^^,^)"-*^ G J7'/3(F,F). 
Thus 

(7.10) A^^^,{A^^^)-^A^,^<s> G j;3(A,A). 

By the definition of the gap 5(^2 ($), 1^2 (^)) from \/2(*) to \4(^), 

(7.11) (1 - (5(y2($), ^2(^)))^) C^v4$,$C < C^A$,vi,(v4vI,,Viy)-Mv,y,$C < C^A<j,,$C 

for all c G £^(A). Combining fl7.6p . fl7.10p and (17. lip , and applying Wiener's 
lemma for infinite matrices in the Jaffard class J7^(A,A) [521 ESI ED], we obtain 
that (A$_^(y4^^^)~^A,j (j,)"-*^ G J'j3{A,A). Thus the reconstruction matrix 

(7.12) R^,^i -^ ^<J>,<J> (^$,iI'(^VI/jVl/) yivl(^<J)j y4<j> vj/(y4vj, vj/) G j7/3(A,F). 

Define a function gF,<i>,^! on £^(A) by 

(7.13) 5'F,*,*(2;) := ^<i.,vi>/F,<i.,*(a;),a; G T, 

where fF,<i>,^ is given in (11.100 . Then the function gF,<s>,^ is well-defined on ^^(A) and 
satisfies 5^(0) =0, and its gradient 

(7.14) VgF,^A^) = /2$,^(^,F'(x^<l>)<l>),x G F, 
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is continuous and bounded in the Jaffard class J'p^A, A) by Lemma EH From (17. lip 
it follow that 

= C R^q,A^\^[R^q,) C = \\c ixcf) v]/W||2 

(7.15) < (1 - (^(V^2($), V^2(^))) V^ c^v4$,$c for all c G ^^(A). 
This together with (17. 3p implies that 

< m-i(l+/i)||c^$||2|M^i?$,vi,^||2 

< m-'B^il + /i) (1 - {SiV^m, V^m))')-'^' \\ch\\dh 

for any x G £^(A) and c, (i G ^^(A), where Bi = sup||cj|2=i ||c"^$||2- This proves that 

(7.16) \\VgF^^ix)\\B(i2,A)) < m-^Bi^^ ^^ for all x G ^^(A). 

Notice that 

for all c G f^ by direct calculation. Hence for any x & dP and c E l"^, 

c^VgF,'S>Ax)c = {F'{x'^^){c^^), c^^) + (F'(x^$)(c^<l>), C^i?$,vi,^ - c^$) 

> m"^(l -/i)||c^<l>||2-m"Vl|c^'^ll2||c^^$,vi/^-c'^$||2 

> m^^(l — /i — /itan6') c"^yl<j>^$c 

(7.17) > m"^v4i(l -/i-/i tan 6')c'^c 

by (17. 3p and (I7.13p . where Ai = inf||cj|2=i ||c"^*&||2 and 



tan^ = SiV2i^), V2m)/^/l- {5iV2m,V2i^W. 

By the above argument, we see that the function gF,<s>,<i' satisfies all requirements 
for the function / in Theorem 14.11 Thus the function gF,<i>,^ is invertible in i^ and 
the gradient of its inverse is bounded and continuous in J'^[A). Then there exists a 
positive constant Cq such that 

(7.18) ||ci - C2\\p < Co||fi'F,$,*(ci) - gF,'S>,^{c2)\\p for all Ci,C2 G £^. 

Hence for any hi = cf$ and /i2 = c^$ G Vp{^), 

\\hi-h2\\p < (sup ||c'^$||p)||ci -C2||p < C||i?$,vi,(S'F,*(/ll) - S'F,*(/i2))||p 
||c||p=l 

< cwsFAhi) - SFAh2)\\p 

by (17.120 . (I7.18P and Lemma [7^ This proves the first inequality in (17.40 . 

The second inequality in (17. 4p follows from (17. 12p and Lemma 17.61 D 
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7.2. Reconstructing signals from averaging samples of their instantaneous 
companding. 

Theorem 7.7. Let K,T he two relatively-separated subsets ofW^, $ := (0a)aga ond 
\l/ := {ip^)^^r have polynomial decay of order (3 > d and generate Riesz bases for 
V2($) and V2{^) respectively, the gap 5(V2($), V2{^)) from V'2($) to V2{^) be strictly 
less than one, the companding function F be a continuously differential function on 
M satisfying -F(O) = and (17.31) for some nonzero constant m, and let R^^<s> be as 
%n dHa). Set 



-{ inf ||c-$||,)ri-^-^— ii^SilaS^) 



and 



m 



Then 

(i) Given any sampling data y = (F(x^$),\l') o/ a signal x^o G ^^ and any 
initial guess Xq G £^(A),1 < p < oo, ^/ie Van-Cittert iteration Xn,n > 0, 
defined by 

(7.19) Xn+i =Xn- aR^^^{{F{xl<l>), ^) - y) 

converges exponentially to x^o in ^^(A) when the relaxation factor a satisfies 
< a <mo/(L + L2). 
(ii) If F" is continuous and bounded, then the quasi-Newton iteration defined by 

(7.20) x„+i = x„ - (i?$,^(^, F'(a;^$)<l>))-ii?,j,,*((F(a:^$), ^) - y), n > 1, 

converges quadratically if the initial guess xq is so chosen that ||(F(a;J^$), ^) — 
y\\p is sufficiently small. 

Remark 7.8. In the proof of Theorem 17. 7[ we show that the Van-Cittert iteration 
(I7.19P converges exponentially for any data y G P'iT), not necessarily the observed 
data (F(x^$),\E') of a signal x G P'{A). Unlike local R-quadratic convergence of 
the quasi-Newton iteration (I7.20p established in Theorem 17. 7i the quasi-Newton 
iteration 

(7.21) x„+i = x„-«„(i?$,*(^,F'(x^$)$))-^i?$,*((F(x^$),^)-y), n>l, 

with appropriate varying step size a„ could have global convergence when p = 2, 
see [T7]. For p = 2, we also remark that the following modified Van-Cittert iteration 

(7.22) Xn+i =Xn- mR{{^>, F[xl^)) - y) , n > 0, 

has exponential convergence in (? with the assumption (17. 3p replaced by a weak 
condition: 

(7.23) /i < ^i-idiy^m.v^mw. 

where R = [A^^\i,{Aq,^^)~^A\i,^q>) A$_^(A*^^)~^. The above exponential conver- 
gence can be proved by following the argument in [19] . Without loss of generality, 
we assume that $ (resp. \E') is an orthonormal basis for V2($) (resp. V2(\E')). Let 
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x^,x^,n > 0, be sequences in the Van-Cittert algorithm f l7.22p with the observed 
data y replaced by 2/1,2/2 ^ ^^- Then it follows from fl7.12p and f l7.22p that 

\\xU,-xl^,h < \\xl-xl-mR{{F{{xlf^),m) - {F{{xlf^),m)))h 

+ \rn\\\yi -Z/2II2 

< \mxl - xlf^ - mF{{xlf^) + mF{{xlY^), ^2 

+ \m\\\yi - 2/2112 

< |m|||2/i-2/2||2+ (1-(5(V2($),V2W))')"'^' 

X II [xl - xlY^ - mF{{xlf^) + mF{{xlY^) || 2 

(7.24) < (1 - {5{y,{^), V,m)YY''^ii\\xl - xlh + \m\\\y, - 2/2II2 

for all n > 0. Taking 2/2 = 2/i = 2/ G £^ in fl7.24p and using f l7.23p shows that the 
map V{x) := X — mR(^{'^, F(x^$)) — 2/) is contractive on £^ and hence has a unique 
fixed point V~^{y). Applying ( I7.24p with 2/1 = 2/2 = 2/ ^^^ Xq = V~^{y) leads to the 
exponential convergence of the Van-Cittert algorithm (17.220 . 

\\xn - V-\y)h < /^"(l - {S{V,{<^), V^2W))')""^'||xo - V'\y)h, n>0. 

Also taking limit in f l7.24p shows that the Van-Cittert algorithm f l7.22p has i"^- 
stability: 



\\V {yi)-V 2/22 < -^ ,.,T./^N T./T^^^9 ?/l - ?/2 2 

for any 2/1,2/2 ^ ^^- From the above argument, we see that the limit V^^{y) of the 
Van-Cittert algorithm (17:221) satisfies R{{'$,F{{T-\y)f<l>)) - y) = 0. The above 
consistence condition is established in |T9] under additional assumption that R is 
invertible. 

Proof of Theorem \7.1\ (i) Let gF,'S>,^ be the function on ^^(A), 1 < p < 00, defined 
in fl7.13p . By the argument in the proof of Theorem 17. 11 the function (/_f,<j>,* satisfies 
all requirements in Theorem 16.11 Then applying Theorem 16.11 gives the exponential 
convergence of the sequence x„,n > 0, in the Van-Cittert iteration (17.190 . and the 
limit follows from the invertibility of the function Qf,^,^ in ^^■ 
(ii) By (I7J2|) and (ITlD . we obtain 

\\^9f,^,Yx) - ^gF,^,^{x)\j^{K) 

(7.25) < C||F"||oo||2;^$-5'^$||oo < C||x-x||oo < C||x-5||p 

for all X, X G i^. Then the local R-quadratic convergence of the quasi-Newton 
iteration (I7.20p follows from Theorem 16.41 D 

7.3. Numerical simulation. In this subsection, we present some numerical sim- 
ulations for demonstration of the theoretical results in Theorem 17.71 Let A = 
{ti}t=i contain randomly selected knots tj G [— 2,2],1 < i < 40, satisfying 0.05 < 
mini<j<39 tj+i - ti < maxi<j<39 tj+i - U < 0.15, F = {-2 + 2/20}^£^ be the set 



30 QIYU SUN 

of uniform knots on [—2,2], $ = {(j)t^)t^^\ be the column vector of interpolating 
cubic splines with knots A satisfying 4>ti{tj) = ^ij for all 1 < i,j < 40 where 5ij 
is the Kronecker symbol, \E' = {10x[-2+(i-i)/2o,-2+i/20)}?£i be the column vector 
of uniform sampling functionals on F, and F{t) = sin(7rt/2) be the companding 
function. In the simulation we use x^o = (ci, . . . , C4o)'^/maxi<j<4o |cj| as the orig- 
inal sequence to be recovered from its nonlinear samples {F{x'^^),'^) (plotted in 
Figure [2]^b)), where q G [—1/2,1/2],! < i < 40. The nonuniform cubic spline 
x^$ is plotted in Figure [2|^a) in a continuous line. We add piecewise random noise 
e = (r(l)a(l),...,r(80)a(80))^||(F(x^$),^)||oo of noise level from 0% to 2.5%, 
plotted in Figure [2]^b) in a dashed line, where r{i) G [—0.05, 0.05], 1 <i< 80, are 
randomly selected and a{i), 1 < i < 80, take value one when i G [1, 16) U [72,80], 
two when i G [24,40) U [48,64), and zero otherwise. We reconstruct the signal x^ 
from the noisy nonlinear samples (F(x^$), \E') +e by applying the Van-Cittert iter- 
ative method fl7.19p with xq = and y = {F{x^^), \1') + e, and plot the difference 
between cubic splines (a;^)^$ and a;^$ in Figure [2t^a) in a dashed line. The nu- 
merical result shows that ||x^ — XooHoo = 0.003, which illustrates the £°°-stability 
of the reconstruction procedure in Theorem 17.71 The nonlinear sampling procedure 
S : X I — > (F(a;^$), \E') is locally behaved as entries in the column vectors $ and \l/ 
are locally supported, which can be observed by comparing the shape of the original 
cubic spline a;^$ in Figure |2I^a) and the nonlinear samples (F(x^$),\E') in Figure 
Mjo)- For the sampling procedure without instantaneous companding (i.e. F(t) = t), 
it is shown in [TJ [59] that the reconstruction procedure is also locally behaved, that 
is, the amplitude of a signal at any position is essentially determined by the adja- 
cent samphng values. We notice that the cubic splines (a;^)^$ and x^$ are almost 
perfectly matched in the interval [0, 0.4] where no noise is added to adjacent nonlin- 
ear samples, which indicates that the reconstruction procedure from the nonlinear 
samples is locally behaved. 

We apply the Van-Cittert iterative method (I7.19P with zero initial guess Xq = 
and relaxation factor a = 0.3 to recover the signal Xoo from its nonlinear samples 
(F(a;^$), \E'). The corresponding numerical error is presented in Tabled! where 
listed in the first column is the number of iteration, listed in the second, third and 
fourth columns are the £°°-error \\xn — Xoojloo, the mean squared error \\xn — X00II2, 
and the £^-error ||xn — Xoo||i respectively, and listed in the last column is the £°°-error 
||(F(x^$), '^) - (F(a;^$), \I^)||oo of nonlinear sample data. 

A difficult problem is how to select the relaxation factor a. We tried to change 
the relaxation factor in every iteration, c.f. (I7.2ip . The ideas are to use smaller 
relaxation factor if the £°°-error || (F(a:^$), ^) — y\\oo between the nonlinear sample 
data of the n-th iteration x„ and the given nonlinear sample data y increases, and to 
use larger relaxation factor when the ratio between ||(F(x^$), \E') — y\\oo and ||y||oo 
gets smaller. The above modification of the Van-Cittert iteration method does 
provide faster convergence, but no significant improvement is observed. We also 
apply the combination of the Van-Cittert iteration method and the quasi-Newton 
iteration method. As shown in Theorem 17. 7[ the Van-Cittert iteration method 
has slow global convergence and the quasi-Newton iteration method has fast local 
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(a) 




(b) 



Figure 2. (a) The cubic spline x^$ is plotted in a continuous line, while 
it is plotted in a dashed line the difference between the original cubic spline 



X. 



T 



^ and the reconstructed cubic spline x^<l> from noisy nonlinear sampled 
data (F(x^$), *) + e. (b) Nonlinear sampled data (F(x^$), *) is plotted 
in a continuous line, and the piecewise random noise e with noise level 
between 0% and 2.5% is in a dashed line. 



convergence. So we may use the Van-Cittert iteration at the beginning and the 
quasi-Newton iteration when the ratio between ||(F(x^$), \1/) — y\\oo and \\y\\oo is 
below certain threshold, say 10%. The numerical error is shown in Tabled where the 
quasi-Newton iteration method f l7.20p is used from the 6-th iteration. Comparing the 
numerical results in Tabled] and Table [21 we may conclude that, in order to recover 
a signal from its nonlinear sample data, it is much better to use the combination of 
the Van-Cittert iteration method and the quasi-Newton iteration method than to 
use the Van-Cittert iteration method solely. 
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Table 1. Reconstruction error via the Van-Cittert iteration 



Iteration 


£°^ -error 


£^- error 


£^— error 
40 


£°°-data 


5 


1.9893 


0.5049 


0.3334 


0.1168 


10 


0.5230 


0.1832 


0.1533 


0.0425 


15 


0.2102 


0.0931 


0.0846 


0.0222 


20 


0.1053 


0.0535 


0.0503 


0.0128 


30 


0.0343 


0.0201 


0.0194 


0.0048 


40 


0.0128 


0.0081 


0.0078 


0.0019 


50 


0.0050 


0.0033 


0.0032 


0.0008 



Table 2. Reconstruction error via a combination of the Van-Cittert 
iteration and the quasi-Newton iteration 



Iteration 


^°^-error 


l'^— error 
%/40 


£^— error 
40 


^°°-data 


5 


1.9893 


0.5049 


0.3334 


0.1168 


6 


0.2372 


0.1175 


0.1073 


0.0896 


7 


0.2034 


0.1033 


0.0954 


0.0250 


8 


0.0232 


0.0170 


0.0168 


0.0222 


9 


0.0010 


0.0008 


0.0007 


0.0037 


10 


0.0000 


0.0000 


0.0000 


0.0002 



8. Local identification of innovation positions and qualification of 

amplitudes 

In this section, we apply the theory established for the nonlinear functional equa- 
tion (II. ip with p = oo in the first two parts of this paper indirectly to local identi- 
fication of innovation positions and qualification of amplitudes of a signal h having 
the parametric representation fll.l3p . In the first subsection, we show that inno- 
vation positions and amplitudes of a signal h having the parametric representation 
fll.l3p can be precisely identified and qualified provided that the linearization at 
approximate innovation positions and amplitudes is stable, see Theorem 18. 1[ In the 
second subsection, we show that any signal h in a. perturbed shift-invariant space 
with unknown (but small) perturbations can be recovered exactly from its average 
samples {h, tpmi' — k)), 1 < m < M, k G Z'^, provided that the generator cp of the 
perturbed shift-invariant space and the average samplers ipm, 1 < m < M, satisfy 
f ll.2ip . In the last subsection, we present some numerical simulations to demonstrate 
the precise identification and accurate qualification. 

8.1. Precise identification of innovation positions and accurate qualifica- 
tion of amplitudes. 

Theorem 8.1. Let Aq andV he relatively-separated subsets of W'- , Cq := (co(A))AeAo ^ 
£°°(Ao), '^ = (V'7)7er have polynomial decay of order (3 > d, the impulse response 
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¥? G C^{R'^) satisfy 

(8.1) ll^(-)(i + 1 ■ D^lloo + l|v^(-)(i + 1 • D^lloo + l|vM-)(i + I ■ D^lloo < oo, 

and let the companding function F G C^(R) satisfy 

(8.2) ||F|U + ||F"||oo<oo. 

// the nonlinear sampling process (11.151) has its linearization at (Aq, Cq) being sta- 
ble (i.e., the matrix S^cco ^'^ fll.171) satisfies fll.161) ). then there exists a positive 
constant 5o such that any signal h, that has the parametric representation h{t) = 
J2xeAo^^oW + c{\))ip(t — A — o"(A)) for some vectors c := (c(A))agAo «^^ "^ '■= 
(o"(A))AeAo '^'^th niax(||c||oo, ||o"||oo) < ^0, can be stably recovered from its sampling 
data (F(/i),*). 

Proof. To prove the desired stable recovery, we need to find a small number ^o and 
two positive constants Ci and C2 such that 

Cl(||ci-C2||oo + |kl-a2||oo) < ||(F(/li)-F(/l2),^)||oo 

(8.3) < Cadlci -C2II00 + Iki -f^2||oo) 

for all vectors q := (Q(A))AeAo and dj := (cri(A))A6Ao with max(||ci||oo, Ho^illoo) < ^o, 
where hi = EAeAo(^o(A) + Ci{X))ip{- - X-ai{X)),i = 1,2. 

By (18.21) and the polynomial decay property for the average sampler \E', we obtain 

\\{Fih)-Fih2),moo 

< C7||F'||oo||^||oo,/3||co + calloojl Yl l^( ■ "^ " ^i(^)) - V'( ■ -^ - ^2(A)) I 

AeAo 

+C||F'||oo||^||oo,;3||ci - C2II00II V M- - A - ai(A))| 

II •^■"^ CO 

AeAo 

< C(l + <5o)''(||Co||oo + <5o)||F'|U||^||oo,/3||V^(-)(l + I ■ D^lloolkl - a2||oo 

+c(i + 5o)^||F|U||^|U,^||<^(-)(i + 1 ■ D'^lloollci - C2II00. 

This proves the second inequality in (18. 3p . 

Now we prove the first inequality in (18. Sp . From (18. ip . (18. 2p and the polynomial 
decay property for the average sampler \1', it follows that 

\{F'{hM. - A - a(A)),^,)| + \{F'{h)V^{- - A - a(A)), V^,)| 

< c\\F'\\^{y{-){i + 1 • D^iu + II vy.(-)(i + 1 • D^iioo) ll^l|oo,/3(i + Iklloo)^ 

(8.4) x(l + |7-A|)~^ for all 7 G r and A G Aq. 
Hence the matrix 

Af^\ ._ f -(co(A) + c(A))(F'(/.)V¥.(--A-a(A)),V^,) 



is well-defined for any c := (c(A))AeAo e £°°(Ao) and a := {a{X))xeAo e (£°^(Ao))'^, 
where /i = ^;^g^^(co(A) + c(A))v9(. — A — cr(A)). Moreover (y4( )) yl( ) belongs to 
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the Jaffard class {Jj3{Kq)Y^^ , and 



<y\\^ ,10 



•5) [Ar)] A[\\ ,„,. „. <C(l + ||alU)^^(l + ||c|| 



by (18 ■4p and the relatively-separatedness of the sets Aq and F. Notice that ^( ) 

becomes the matrix Saq.co i^i (I1-17P when cr = and c = 0. Then (5'ao,co)"^'S'ao,co 
belongs to the Jaffard class (j7/3(Ao))'^"'"^ by (18.51) . This, together with the stabihty 
condition (11.161) and the Wiener's lemma for infinite matrices in the Jaffard class 
[321 [58], proves that ((5'ao,co)"^'S'ao,co)~"'^ belongs to the Jaffard class (j7'^(Ao))'^"'"^; i.e., 

(8-6) II((5'ao,co) 5'ao,co)" ||(:7^(Ao))d+i < a 

for some positive constant D^- Using similar argument to prove (18. 4p . we get 

|(F(/,)^(. _ A - a(A)),^,) - (F'(M^(- - A),^,)| 

+ |(F'(/i)V(/.(- - A - a(A)), V^,) - (F'(MVv.(- - A), V^,)| 

(8.7) < C(l + ||a|U)^(||a|U + ||c||oo)(l + |A-7|)-^ 
for all A G Aq and 7 G F. Therefore 

||(('S'ao,co) 'S'ao.co) "^Ao.co^ic) ~-^II(J^(Ao))''+i 

(8.8) < C(l + ||a||oo)^(l + ||c||oo)(||c||oo + |k||oo), 

where / is the identity matrix of appropriate size. For the function /ao,co,* in (11-180 . 
we notice that 

Then V/ao,co,^( ) belongs to the Jaffard class {Jp{^k^Y^^ s-^d 

(8.9) ||V/ao,co,*Q - ^||(^,(Ao))^+i < C{\ + l|al|)^(l + l|clU)(l|cl|oo + Iklloo) 

by (18.81) . Recall that any infinite matrix in the Jaffard class {J^^k^Y^^ is a bounded 
operator on (£°°(A))'^+^ Thus there exists a positive number b^ such that 

(8-10) ||V/Ao,co,>&(^) - ^||B((^oo(Ao))d+i) < 3 

for vectors a G (£°°(Ao))'^ and c G £°°(Ao) with max(||c||oo, ||o"||oo) < <5o- This implies 
that there exists a positive constant 6q such that 

-max(||ai-(T2||oo,||ci-C2||oo) < ||/Ao,co,*Q) - /Ao,co,*Q) |L 

4 

(8.11) < -max(||cri - cr2||oo, ||ci -C2II00) 

for vectors ctj G (£°^(Ao))'^ and q G £°°(Ao) with max(||Q||oo, ||o"j||oo) < f^o,"^ = 1,2. 
The first inequality in (|0]) then follows from ([831), (M and ( [8lT|) . D 
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Theorem 8.2. Let ip, \1/, F, Aq, cq, 6q be as in Theorem \8.1[ and fAo,co,^ (is in f ll.lSp . 
Given the sampling data y = {F{h), \I/) of a signal h = J^xeA^^oi^) + c( A) )(/)(■ — A — 

(t(A)) with c = (c(A))AeAo a'^d o = (o-(A))AeAo satisfying max (||c||oo, llo^lU) < <5o/2, 
we define the Van-Cittert iteration by 

("2) G:::)=G:)-"(^^--G:)-^»). «s°> 

wttk (2) = 0,a e (0,1), a,ul z„ = (S»„,^)^SA„,„)-iSj,„„(t, - (^(Ao),*)). Then 
{rP)y^ — 0; converges to the solution ( ) exponentially. 



Proof By (ISTTOl) . (ISTTIl and (18121) . we have 



4q; 
max(||ai||oo, IMilU) < ^max(||cr||oo, ||c||oo) 

and 

max(||cr„+i - (T„||oo, \\dn+i -dnWoo) < — - — max(||a-„ -o-„_i||oo, |Mn - C^n-lIU) 

for all n > 1. Hence max(||(T„||oo, IMn||oo) < Sq and the sequence ( ,"),n > 0, in the 



Van-Cittert iteration 08.121) converges to the solution ( ) exponentially. D 



/0'\ 



8.2. Sampling in a perturbed shift-invariant space with unknown pertur- 
bation. 

Theorem 8.3. Let ip satisfy (18. ip and ipi, . . . , ipM satisfy 

(8.13) J2 ll^m(-)(l + |-|)^l|oo<0O. 

l<m<M 

If (ll.2ip holds, then for any L > 1 there exists a positive number 6i G (0, 1/2) 
such that any signal h(t) = J2kei.<i c{k)ip{t — k — cr^k)) with \\{cr{k))kezA\oo < ^i o.i^'d 
||(c(/c))fcg2d||^°o := sup^(-^)_^o |c(^)| + |c(A;)|^"'^ < L can be recovered from its average 
sample data {h,iprn{- — k)), 1 < m < M,k E Z'^, in a stable way. 

Remark 8.4. Let ip and tpi, . . . , ipM be as in Theorem 18.31 and let 

V2{^,V^) = { J2 {eo{kM--k) + {e,{k)fVv{-~k))\ J^ |eo(A;)p + |e,(A;)p < oo} 

be the shift-invariant space generated by ip and its first-order partial derivatives. 
Then an equivalent formulation of the condition (11.210 is that the integer-shifts of (p 
and its first-order partial derivatives form a Riesz basis for the space V2{(p, Vip) and 
signals h living in V2{(p,'V(p) can be recovered stably from their samples {h,ipm{' — 
k)),l < m < M, k e Z*^. The readers may refer to [H |31 E21 EJ] and references 
therein for sampling and reconstruction of signals in a shift-invariant space. 
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Proof of TheoremlEE By flLTTj) . the vector A{^) := ([^, ^i](0, ■ ■ ■ , ([^, V'mJIO) is 
nonzero for all ^ G M'^. Here the bracket product is defined as follows: [/,(?] (0 = 
E;g^,/(e + 2/7r)<7(e + 2/7r). Hence 

M 

(8.14) i?(0:= J]|[^,V^J(OI'>0 foralUGR'^. 



m=l 



By (18. ip and (18.131) . the Fourier coefficients of [^yi^mliOy 1 < "^ < M, have polyno- 
mial decay of order f3 > d. Here a periodic function /(^) = XlfceZ'' Cf{k)e~'^^^ is said 
to have Fourier coefficients with polynomial decay of order /3 > if sup^g^'' |c/(^)(l + 
|fc|)'^ < oo. This, together with (18.141) and Wiener's lemma for infinite matrices in 
the Jaffard class [221 EH], implies that {R{C,))~^ has Fourier coefficients with polyno- 
mial decay of order (3 > d. So does 



U5) mor'MO ■■= ( E ^i(^)e-^'^ ■ ■ ■ ^ E ^M{k)e~'' 



ikS, 

Thus 



(8.16) D2:= sup E l^'"(^)l <°°- 



'^"^^''k^Z^ 



Given the sampling data ymik) := (/i, ifjmi,- — k)), 1 < m < M, k E Z"', of a signal 
H^) = Efcezdc(A;)v2(--A;-cr(A;)) satisfying \\{c{k)) k^zAle^ < ^ and ||(cr(A;))feg2d||oo < 
5i. Define c := (c(A;))fegzd by c{k) = Y.m=i Y.k'&'i'^rni.k - k')ym{k'),k E I/. From 
the construction of vectors (rm(A;))fcg2d5 we see that c{k) = X]m=i Xlfc'ezd '^'"(^ ~ 
k'){h,iljm{- — k')) for all k E Z^, where h = 'Ylik&Z'i^i^)v{' ~ ^)- This together with 
fl8T^ gives that 



M 

< Co||c||oo||cr| 
, , ^ no 

m=l k& 



|c-c||oo < D2\y2 IIV^m||lj||c||oo ^ IV^(' ~ ^ ~ ^(^)) ~ V^(' ^ ^) I 



for some positive constant Cq. Therefore, if 5i < l/(3Co-L^), the vector cq := 
(co(fc))fe6Zd defined by 

has the same support, say Ag, as the one of the amplitude vector c of the signal h 
to be recovered, and satisfies 

(8.18) ||co - c||oo < C'o-L||o-||oo- 

So we may consider XlfceA '^o(^)v'(' ~ ^) as an approximation of the signal h = 
EfceAo c(^)¥'(- - ^ - f^(^)) = Efcezd c(A;)v?(- - fc - ct(A;)) to be recovered. 



NONLINEAR FUNCTIONAL EQUATIONS AND SAMPLING 37 

Let Co = (co(A))AeAo, ^ = {i'mi- - /^)}i<m<M,fcezd, and Sao,co be the the hneariza- 
tion matrix in flTTTl) . Then for any e = (e(A))AeAo ^ {f{Ao)Y+^, 

M 

\\Sk,,cAI = E E |(^™(- - ^)' E ( - 5o(A)e,(A)^V^(- - A) + e„(A)y.(- - A))> 
> C( E |5o(A)ne,(A)r + |eo(A)p) > C L-^e\\U ,,^,,,,. 



AgAo 



and 



||5A„,eoe||^ < C^ll E ( - £o(A)e,(A)^V^(- - A) + e,(A)^(- - A)) 

AeAo 

< C'l|e||(^2(A„))d+i(l + ||co||£oo(Ao)) < CL ||e||(^2(AQ))d+i, 

by (OH), dUD, ^^ and flSTTK]) . where e(A) = (^''!^|),A G Aq. The above esti- 

mates lead to the conclusion that the linearization matrix S'aq.cq satisfies the sta- 
bility condition fll.l6p . This together with f lS.lSp and Theorem 18.11 completes the 
proof. D 

8.3. Numerical simulation. In the following simulation, the signal h to be recov- 
ered has the following parametric representation 

20 

(8.19) h{t) = Y^ai^^{t-U), 

i=l 

where v'o(^) = exp(— 4(7r/2)^/^t^), the innovation positions tj, 1 < z < 20, are ran- 
domly selected numbers in [0.5,19.5] satisfying ti = 0.5, t2o = 19.5 and 0.5 < 
mini<j<i9 tj+i — ti< maxi<j<i9 tj+i —ti< 1.5, and the amplitudes Oj, 1 < z < 20, are 
random selected numbers in [—1, —0.1] fl [0.1, 1]. We consider the recovery of such 
a signal h as it can be used to model diffusion of point sources of pollution and the 
generating signal yjo does not satisfy the Strang-Fix condition. 

The given samples i/j, 1 < j < 41, of the signal h are obtained by average sampling 
the companded signal sin(7r/i(t)/2) by the shifted square-root sampler ipQ, 

(8.20) y, = (sin(7r/i(-)/2)x[o,2o], V^o(- + 1 - j72)), 1 < j < 41, 
where 

{max(l/4-|2t-l/4|,0) if < t < 1/4 

4t - 1 if 1/4 < t < 1/2 

1 ifl/2<t<l 

otherwise 

is the square-root sampling kernel, see Figure IH The approximate innovation posi- 
tions to,j and amplitudes Co,i, 1 < « < 20, are given by 

ao,i = LlOa*J/10 and to,i = [lOtJ/lO, 1 < i < 20, 

where \_a\ is the largest integer less than or equal to a G M. We use the Van- 
Cittert iteration (I8.12p in Theorem 18.21 to recover the exact innovation positions 
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Figure 3. The original signal h{t) = Yli=i ^i^oi^ — ii) to be recovered is 
plotted in a continuous line, while the difference between the original signal 



h{t) and the approximate signal happ{t) 
in a dashed line. 



Yli=i ao,i(po{t - io,i) is plotted 




0.2 0.4 0.6 



Figure 4. The square-root sample i/jq in (I8.2ip . 



0.5 as the relaxation factor. 



ooiioo in the second column, 



and amplitudes with cq = ctq = as initials and a 
In Tables [3] below, we list the amplitude errors ||c„ — c, 
the innovation position errors Han — cTooHoo in the third column, and the sampling 
errors ||(F(/i„) — F(/i), \l/)||oo in the forth column, where F{t) = sin(7rt/2) and 
\l/ = (V'ol" + 1 ~ j/2)x[o,2o])i<i<4i- We observe that the sequences an and Cn,n > 0, 
in the Van-Cittert iteration f l8.12p converges and their limits, denoted by cToo and Cqo 
respectively, satisfy a^o = (ti — to,«)i<i<2o and Cqo = (oj — ao,j)i<i<2o- Hence we reach 
to the desired conclusion that the signal h in fl8.19p can be recovered accurately 
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Table 3. Local identification of innovation positions and qualifica- 
tion of amplitudes via the Van-Cittert iteration method 



n 



Cr?, Co 



ar, 



(Jr 



(F(M-F(/i),M/) 



1 


0.1465 


0.4085 


0.2805 


5 


0.1459 


0.0292 


0.1590 


10 


0.0088 


0.0045 


0.0140 


15 


0.0005 


0.0004 


0.0007 


>20 


0.0000 


0.0000 


0.0000 



from its samples via the Van-Cittert iteration f l8.12p when its innovation positions 
and amplitudes are given approximately. Moreover, the above recovery process is 
stable in the presence of bounded noise in Theorem 15. 1[ In Table H] below, we list 
numerical results when we apply the Van-Citert iteration fl8.12p with exact samples 
2/j5 1 < j < 41, in f l8.20p replaced by the samples ^j, 1 < j < 41, corrupted by 5% 
random additive noise, i.e., 



Vi = Vi + 0.05 * e, * ( max 



\yk\), i<j<4i. 



where ej G [—1, 1], 1 < j < 41, are random noise. 

Table 4. Local identification of innovation positions and qualifica- 
tion of amplitudes via the Van-Cittert iteration method in the pres- 
ence of 5% bounded random noise 



n 



Cn Co 



Cr, 



(Jr. 



\{Fih^)-Fih),^)\ 



1 


0.1725 


0.4593 


0.2805 


5 


0.3059 


0.0818 


0.3769 


10 


0.1110 


0.0716 


0.0820 


15 


0.1110 


0.0847 


0.0648 


> 19 


0.1110 


0.0853 


0.0648 
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